The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Local Directional Pattern Variance (LDPv): A Robust Feature Descriptor for Facial

 Automatic  facial  expression  recognition  is  a  challe nging  problem  in  computer  vision,  and  has  gained  si gnificant  importance in the applications of human-computer in teractions. The vital component of any successful expression recognition  system  is  an  effective  facial  representation  from  f ace  images.  In  this  paper,  we  have  derived  an  appea rance-based  feature  descriptor,  the  Local  Directional  Pattern  Variance  (LDPv),  which  characterizes  both  the  texture  and  co ntrast  information  of  facial  components.  The  LDPv  descriptor  is  a  collect ion  of  Local  Directional  Pattern  (LDP)  codes  weight ed  by  their  corresponding  variances.  The  feature  dimension  is  t hen  reduced  by  extracting  the  most  discriminative  e lements  of  the  representation  with  Principal  Component  Analysis  (P CA).  The  recognition  performance  based  on  our  LDPv  descriptor  has  been  evaluated  using  Cohn-Kanade  expression  databas e  with  a  Support  Vector  Machine  (SVM)  classifier.  The  discriminative  strength  of  LDPv  representation  is  also  assessed  ov er  a  useful  range  of  low  resolution  images.  Experim ental  results  with  prototypic  expressions  show  that  the  LDPv  descripto r  has  achieved  a  higher  recognition  rate,  as  compared  to  other  existing  appearance-based feature descriptors .    


[1] Ahonen T., Hadid A., and Pietikainen M., Face Description with Local Binary Patterns: Application to Face Recognition, IEEE Transaction on Pattern Analysis and Machine Intelligence , vol. 28, no. 12, pp. 2037-2041, 2006.

[2] Ahonen T., Hadid A., and Pietik inen M., Face Recognition with Local Binary Patterns, in Proceedings of 8 th European Conference on Computer Vision , Berlin, pp. 469-481, 2004.

[3] Bassili N., Emotion Recognition: The Role of Facial Movement and the Relative Importance of Upper and Lower Area of the Face, Journal of Personality and Social Psychology , vol. 37, no. 11, pp. 2049-2058, 1979.

[4] Bartlett S., Littlewort G., Frank M., Lainscsek C., Fasel I., and Movellan J., Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , California, vol. 2, pp. 568- 573, 2005.

[5] Bartlett S., Movellan J., and Sejnowski J., Face Recognition by Independent Component Analysis, IEEE Transactions on Neural Networks , vol. 13, no. 6, pp. 1450-1464, 2002.

[6] Brunelli R. and Poggio T., Face Recognition: Features Versus Templates, IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 15, no. 10, pp. 1042-1052, 1993. 390 The International Arab Journal of Infor mation Technology, Vol. 9, No. 4, July 2012

[7] Chao-Fa C. and Shin F., Recognizing Facial Action Units Using Independent Component Analysis and Support Vector Machine, Pattern Recognition , vol. 39, no. 9, pp. 1795-1798, 2006.

[8] Cohen I., Sebe N., Garg A., Chen L., and Huang T., Facial Expression Recognition from Video Sequences: Temporal and Static Modeling, Computer Vision and Image Understanding , vol. 91, no. 1-2, pp. 160-187, 2003.

[9] Donato G., Bartlett S., Hagar C., Ekman P., and Sejnowski J., Classifying Facial Actions, IEEE Transaction on Pattern Analysis and Machine Intelligence , vol. 21, no. 10, pp. 974-989, 1999.

[10] Ekman P. and Friesen W., Facial Action Coding System: A Technique for Measurement of Facial Movement , Consulting Psychologists Press, 1978.

[11] Fasel B. and Luettin J., Automatic Facial Expression Analysis: A Survey, Pattern Recognition , vol. 36, no. 1, pp. 259-275, 2003.

[12] Gundimada S. and Asari K., Facial Recognition Using Multisensor Images Based on Localized Kernel Eigen Spaces, IEEE Transactions on Image Processing , vol. 18, no. 6, pp. 1314-1325, 2009.

[13] Hsu C. and Lin C., A Comparison on Methods for Multi-Class Support Vector Machines, IEEE Transactions on Neural Networks , vol. 13, no. 2, pp. 415-425, 2002.

[14] Jabid T., Kabir H., and Chae O., Local Directional Pattern for Face Recognition, in Proceedings of IEEE International Conference on Consumer Electronics , NV, pp. 329-330, 2010.

[15] Kanade T., Cohn J., and Tian Y., Comprehensive Database for Facial Expression Analysis, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition , France, pp. 46-53, 2000.

[16] Kumar A., Analysis of Unsupervised Dimensionality Reduction Techniques, Computer Science and Information System s, vol. 6, no. 2, pp. 217-227, 2009.

[17] Lajevardi M. and Hussain M., Feature Extraction for Facial Expression Recognition Based on Hybrid Face Regions, Advances in Electrical and Computer Engineering , vol. 9, no. 3, pp. 63-67, 2009.

[18] Lajevardi M. and Hussain M., Higher Order Orthogonal Moments for Invariant Facial Expression Recognition, Digital Signal Processing , vol. 20, no. 6, pp. 1771-1779, 2010.

[19] Manjunath S. and Ma Y., Texture Features for Browsing and Retrieval of Image Data, IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 18, no. 8, pp. 837-842, 1999.

[20] Meulders M., Boeck D., Mechelen V., and Gelman A., Probabilistic Feature Analysis of Facial Perception of Emotions, Applied Statistic s, vol. 54, no. 4, pp. 781-793, 2005.

[21] Ojala T. and Pietikainen M., Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns, IEEE Transaction on Pattern Analysis and Machine Intelligence , vol. 24, no. 7, pp. 971-987, 2002.

[22] Pantic M. and Rothkrantz M., Automatic Analysis of Facial Expressions: the State of the Art, IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 22, no. 12, pp. 1424- 1445, 2000.

[23] Qader H., Ramli A., and Haddad S., Fingerprint Recognition Using Zernike Moments, International Arab Journal of Information Technology , vol. 4, no. 4, pp. 372-376, 2007.

[24] Shan C., Gong S., and McOwan P., Robust Facial Expression Recognition Using Local Binary Patterns, in Proceedings of IEEE International Conference Image Processing , pp. 914-917, 2005

[25] Shan C., Gong S., and McOwan P., Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study, Image and Vision Computing , vol. 27, no. 6, pp. 803-816, 2009.

[26] Tian Y., Brown L., Hampapur A., Pankanti S., Senior A., and Bolle R., Real World Real-Time Automatic Recognition of Facial Expressions, in Proceedings of IEEE Workshop on Performance Evaluation of Tracking and Surveillance , USA, pp. 9-16, 2003.

[27] Tian Y., Kanade T., and Cohn J., Facial Expression Analysis: Handbook of Face Recognition , Springer, 2003.

[28] Tian Y., Evaluation of Face Resolution for Expression Analysis, in Proceedings of CVPR Workshop on Face Processing in Video , USA, pp. 82, 2004.

[29] Turk A. and Pentland P., Face Recognition Using Eigenfaces, in Proceedings of Computer Vision and Pattern Recognition , USA, pp. 586- 591, 1991.

[30] Uddin Z., Lee J., and Kim T., An Enhanced Independent Component-Based Human Facial Expression Recognition from Video, IEEE Transactions Consumer Electronics , vol. 55, no. 4, pp. 2216-2224, 2009.

[31] Valstar M., Patras I., and Pantic M., Facial Action Unit Detection Using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshop , USA, vol. 3, pp. 76-84, 2005.

[32] Valstar M. and Pantic M., Fully Automatic Facial Action Unit Detection and Temporal Analysis, in Proceedings of IEEE Conference Local Directional Pattern Variance (LDPv): A Robust Feature Descriptor for Facial Expression Recognition 391 on Computer Vision and Pattern Recognition Workshop , New York, pp. 149, 2006.

[33] Zhang Z., Lyons M., Schuster M., and Akamatsu S., Comparison between Geometry-Based and Gabor-Wavelets-Based Facial Expression Recognition using Multi-Layer Perceptron, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition , USA, pp. 454-459, 1998.

[34] Zhao G. and Pietikainen M., Boosted Multi- Resolution Spatiotemporal Descriptors for Facial Expression Recognition, Pattern Recognition Letters , vol. 30, no. 12. pp. 1117-1127, 2009.

[35] Zhou H., Wang R., and Wang C., A Novel Extended Local-Binary-Pattern Operator for Texture Analysis, Information Sciences , vol. 178, no. 22, pp. 4314-4325, 2008. Hasanul Kabir received his BSc degree in computer science and information technology from the Islamic University of Technology, Bangladesh in 2003, and PhD degree in computer engineering from Kyung Hee University, South Korea in 2011. Currently he is serving as an assistant professor in the Department of CSE in Islamic University of Technology. His research interests include feature extraction, motion estimation, computer vision, and pattern recognition. Taskeed Jabid received his BSc degree in computer science from East West University, Bangladesh in 2001. He worked as a lecturer in the Computer Science and Engineering Department of East West University, Bangladesh. Currently, he is pursuing his PhD degree in the Department of Computer Engineering, Kyung Hee University, South Korea. His research interests include texture analy sis, image processing, computer vision, and pattern recognition. Oksam Chae received his BSc degree in electronics engineering from Inha University, South Korea in 1977. He completed his MS and PhD degree in electrical and computer engineering from Oklahoma State University, USA in 1982 and 1986, respectively. In 1986-88 he worked a s research engineer for Texas Instruments, USA. Since 1988, he has been working as a professor in the Department of Computer Engineering, Kyung Hee University, South Korea. His research interests inc lude multimedia data processing environments, intelligen t filter, motion estimation, intrusion detection syst em, and medical image processing in dentistry. He is a member of IEEE, SPIE, KES and IEICE.