KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Robust Face Recognition under Limited Training Sample Scenario using Linear Representation

  • Iqbal, Omer (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus) ;
  • Jadoon, Waqas (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus) ;
  • ur Rehman, Zia (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus) ;
  • Khan, Fiaz Gul (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus) ;
  • Nazir, Babar (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus) ;
  • Khan, Iftikhar Ahmed (Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus)
  • Received : 2017.10.02
  • Accepted : 2018.01.26
  • Published : 2018.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, several studies have shown that linear representation based approaches are very effective and efficient for image classification. One of these linear-representation-based approaches is the Collaborative representation (CR) method. The existing algorithms based on CR have two major problems that degrade their classification performance. First problem arises due to the limited number of available training samples. The large variations, caused by illumintion and expression changes, among query and training samples leads to poor classification performance. Second problem occurs when an image is partially noised (contiguous occlusion), as some part of the given image become corrupt the classification performance also degrades. We aim to extend the collaborative representation framework under limited training samples face recognition problem. Our proposed solution will generate virtual samples and intra-class variations from training data to model the variations effectively between query and training samples. For robust classification, the image patches have been utilized to compute representation to address partial occlusion as it leads to more accurate classification results. The proposed method computes representation based on local regions in the images as opposed to CR, which computes representation based on global solution involving entire images. Furthermore, the proposed solution also integrates the locality structure into CR, using Euclidian distance between the query and training samples. Intuitively, if the query sample can be represented by selecting its nearest neighbours, lie on a same linear subspace then the resulting representation will be more discriminate and accurately classify the query sample. Hence our proposed framework model the limited sample face recognition problem into sufficient training samples problem using virtual samples and intra-class variations, generated from training samples that will result in improved classification accuracy as evident from experimental results. Moreover, it compute representation based on local image patches for robust classification and is expected to greatly increase the classification performance for face recognition task.

Keywords

References

  1. X. Song, X. Yang, C. Shao and J. Yang, "Parity symmetrical collaborative representation-based classification for face recognition," International Journal of Machine Learning and Cybernetics, Volume 8, Issue 5, pp 1485-1492, October 2017. https://doi.org/10.1007/s13042-016-0520-4
  2. T. Larrain, J. S. Bernhard, D. Mery and K. W. Bowyer, "Face Recognition Using Sparse Fingerprint Classification Algorithm," IEEE Transactions on Information Forensics and Security, 1646 - 1657, 09 March 2017.
  3. H. Li, F. Shen, C. Shen, Y. Yang and Y. Gao, "Face recognition using linear representation ensembles," Pattern Recognit., pp. 1-16, 2016.
  4. Y. Wen, W. Liu, M. Yang, Y. Fu, Y. Xiang and R. Hu, "Structured occlusion coding for robust face recognition," Neurocomputing, vol. 178, pp. 11-24, 2016. https://doi.org/10.1016/j.neucom.2015.05.132
  5. H. Zhang, F. Wang, Y. Chen, W. Zhang, K. Wang, and J. Liu, "Sample Pair based Sparse Representation Classification for Face Recognition," Expert Systems with Applications, vol. 45, pp. 352-358, 2016. https://doi.org/10.1016/j.eswa.2015.09.058
  6. W. Jadoon, L. Zhang, and Y. Zhang, "Extended collaborative neighbor representation for robust single-sample face recognition," Neural Comput. Appl., vol. 26, no. 8, pp. 1991-2000, 2015. https://doi.org/10.1007/s00521-015-1843-x
  7. F. Dornaika and A. Bosaghzadeh, "Adaptive graph construction using data self-representativeness for pattern classification," Information Sciences, vol. 325, pp. 118-139, 2015. https://doi.org/10.1016/j.ins.2015.07.005
  8. L. Yang, and I. Wassell, "A New Face Recognition Algorithm based on Dictionary Learning for a Single Training Sample per Person," in Proc. of BMVC, pp. 69-1, 2015.
  9. C. Ding and D. Tao, "Robust Face Recognition via multimodal deep face representation IEEE Transactions on Multimedia," vol. 17, no. 11, pp. 2049-2058, 2015. https://doi.org/10.1109/TMM.2015.2477042
  10. S. Bektas, O. May, Y. Sisman and O. May, "The comparison of L1 and L2-norm minimization methods," International Journal of the Physical Sciences, Vol. 5(11), pp. 1721-1727, 2010.
  11. N. Zhu, T. Xu, L. Wei and T. Tang, " A nearest neighbor classifier based on virtual test samples for face recognition," Opt. - Int. J. Light Electron Opt., vol. 126, no. 21, pp. 2799-2803, 2015. https://doi.org/10.1016/j.ijleo.2015.07.014
  12. R. X. Ding, D. K. Du, Z. Huang, Z. Li and K. Shang, "Variational feature representation-based classification for face recognition with single sample per person," J. Vis. Commun. Image Represent. vol. 30, pp. 35-45, 2015. https://doi.org/10.1016/j.jvcir.2015.03.001
  13. F. Dornaika, A. Bosaghzadeh, H. Salmane and Y. Ruichek, "Graph-based semi-supervised learning with Local Binary Patterns for holistic object categorization," Expert Syst. Appl., vol. 41, no. 17, pp. 7744-7753, 2014. https://doi.org/10.1016/j.eswa.2014.06.025
  14. J. Wang, C. Lu, M. Wang and P. Li, "Robust Face Recognition via Adaptive Sparse Representation," IEEE transactions on cybernetics, vol. 44, no. 12, pp. 2368-2378, 2014. https://doi.org/10.1109/TCYB.2014.2307067
  15. F. A. N. Liu, J. Tang, Y. A. N. Song, L. Zhang and Z. Tang, "Local Structure based Sparse Representation for Face Recognition," ACM Transactions on Intelligent Systems and Technology (TIST), vol. 7, no. 1, pp.2, 2015.
  16. I. Naseem, R. Togneri and M. Bennamoun, "Linear regression for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 2106-2112, 2010. https://doi.org/10.1109/TPAMI.2010.128
  17. A. Rahim, N. Hossain, T. Wahid, and S. Azam, "Face Recognition using Local Binary Patterns (LBP)," Global Journal of Computer Science and Technology, vol. 13, no. 4, pp. 469-481, 2013.
  18. J. Waqas, Z. Yi and L. Zhang, "Collaborative neighbor representation based classification using l(2)-minimization approach," Pattern Recognition Letters, vol. 34, no. 2, pp. 201-208, 2013. https://doi.org/10.1016/j.patrec.2012.09.024
  19. J. X. Mi and J. X. Liu, "Face recognition using sparse representation-based classification on k-nearest subspace," PLoS One, vol. 8, no. 3, p. e59430, 2013. https://doi.org/10.1371/journal.pone.0059430
  20. Jian-Xun Mi,"Face image recognition via collaborative representation on selected training samples," International Journal for Light and Electron Optics, vol. 124, no. 18, pp. 3310-3313, 2013. https://doi.org/10.1016/j.ijleo.2012.10.051
  21. Pengfei Zhu, Yang Meng, Lei Zhang and Il-Yong Lee, "Local generic representation for face recognition with single sample per person," in Proc. of Asian Conference on Computer Vision, pp. 34-50. Springer, Cham, 2014.
  22. J. Mi, D. Huang, B. Wang and X. Zhu, "The nearest-farthest subspace classification for face recognition," Neurocomputing, vol. 113, pp. 241-250, 2013. https://doi.org/10.1016/j.neucom.2013.01.003
  23. Y. Xu and Q. Zhu, "A simple and fast representation-based face recognition method," Neural Computing and Applications, pp. 1543-1549, 2013.
  24. A. Y. Yang, J. Wright, S. Member, Y. Ma, S. Member, and S. S. Sastry, "Feature Selection in Face Recognition : A Sparse Representation Perspective," IEEE Trans. Pattern Anal. Mach. Intell., no. August, pp. 1-34, 2007.
  25. A. Y. Yang, Z. Zhou, A. G. Balasubramanian, S. S. Sastry and Y. Ma,"Fast L1-Minimization Algorithms for Robust Face Recognition," IEEE Transactions on Image Processing, vol. 22(8), pp. 3234-3246, 2013. https://doi.org/10.1109/TIP.2013.2262292
  26. W. Deng, J. Hu and J. Guo, "Extended SRC : Undersampled Face Recognition via Intraclass Variant Dictionary," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 9, pp. 1864-1870, 2012. https://doi.org/10.1109/TPAMI.2012.30
  27. E. Bilgazyev, B. Efraty, S. Shah and I. Kakadiaris, "Sparse Representation-Based Super Resolution for Face Recognition At a Distance," Procedings Br. Mach. Vis. Conf. 2011, pp. 52.1-52.11, 2011.
  28. L. Zhang, M. Yang and X. Feng, "Sparse Representation or Collaborative Representation : Which Helps Face Recognition ?," in Proc. of IEEE international conference on Computer vision (ICCV), pp. 471-478, 2011.
  29. T. Zhang, X. Li and R. Guo, " Producing virtual face images for single sample face recognition," Opt. - Int. J. Light Electron Opt., vol. 125, no. 17, pp. 5017-5024, 2014. https://doi.org/10.1016/j.ijleo.2014.01.171
  30. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, 2009. https://doi.org/10.1109/TPAMI.2008.79
  31. Y. Xu, Q. Zhu, Y. Chen and J.S. Pan, "An improvement to the nearest neighbor classifier and face recognition experiments," Int. J. Innov. Comput. Inf. Control, vol. 9, no. 2, pp. 543-554, 2013.
  32. Y. Xu, X. Zhu, Z. Li, G. Liu, Y. Lu and H. Liu, "Using the original and ' symmetrical face ' training samples to perform representation based two-step face recognition," Pattern Recognition, vol. 46, no. 4, pp. 1151-1158, 2013. https://doi.org/10.1016/j.patcog.2012.11.003
  33. Nhat Vo Dinh Minh and SungYoung Lee, "Kernel-based 2DPCA for face recognition," in Proc. of IEEE International Symposium on Signal Processing and Information Technology, pp. 35-39, 2007.
  34. F. S. Samaria, & A. C. Harter, "Parameterization of a stochastic model for human face identification," in Proc. of Proceedings of the Second IEEE Workshop on Applications of Computer Vision, pp 138-142, 1994.
  35. AT&T LAB of the University of Cambridge, UK, ORL face database [EB/OL], 2010.
  36. A. M. Martinez and R. Benavente, "The AR Face Database," CVC Technical Report 24, 1998.
  37. A. Georghiades, P. Belhumeur and D. Kriegman, "From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001. https://doi.org/10.1109/34.927464
  38. M. Wan, Z. Lai, G. Yang, Z. Yang, F. Zhang and H. Zheng, "Local graph embedding based on maximum margin criterion via fuzzy set," Fuzzy Sets and Systems, vol. 318, pp. 120-131, 2017. https://doi.org/10.1016/j.fss.2016.06.001
  39. F. Liu, J. Tang, Y. Song, Y. Bi, and S. Yang, "Local structure based multi-phase collaborative representation for face recognition with single sample per person," Information Sciences, vol. 346, pp. 198-215, 2016.
  40. Z. Li, J. Liu, J. Tang, and H. Lu, "Robust structured subspace learning for data representation," IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 10, pp. 2085-2098, 2015. https://doi.org/10.1109/TPAMI.2015.2400461
  41. Z. Li, J. Liu, Y. Yang, X. Zhou and H. Lu, "Clustering-guided sparse structural learning for unsupervised feature selection," IEEE Transactions on Knowledge and Data Engineering, vol. 26(9), pp. 2138-2150, 2014. https://doi.org/10.1109/TKDE.2013.65
  42. Z. Zhengjuan and W. Jadoon, "Intrinsic Structure based Feature Transform for image classification," Journal of Visual Communication and Image Representation, Vol. 38. pp. 735-744, 2016. https://doi.org/10.1016/j.jvcir.2016.04.016
  43. M. Yang, X. Wang, G. Zeng and L. Shen, "Joint and collaborative representation with local adaptive convolution feature for face recognition with single sample per person," Pattern Recognition, Vol. 66. pp. 117-128, 2017. https://doi.org/10.1016/j.patcog.2016.12.028
  44. P. Zhu, L. Zhang, Q. Hu and S. C. Shiu, "Multi-scale patch based collaborative representation for face recognition with margin distribution optimization", in Proc. of European Conference on Computer Vision, Springer, Berlin, Heidelberg. pp. 822-835, 2012.
  45. S. Gao, Y. Zhang, K. Jia and Y. Zhang, "Single sample face recognition via learning deep supervised autoencoders," IEEE Transactions on Information Forensics and Security, vol. 10, no. 10, pp. 2108-2118, 2015. https://doi.org/10.1109/TIFS.2015.2446438
  46. G. Koch, Z. Richard and S. Ruslan, "Siamese neural networks for one-shot image recognition," in Proc. of ICML Deep Learning Workshop, Vol. 2. 2015.
  47. Y. Taigman, M. Yang, M.A. Ranzato and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proc. of Proceedings of the IEEE conference on computer vision and pattern recognition, pp.1701-1708, 2014.
  48. F. Schroff, K. Dmitry and P. James, "Facenet: A unified embedding for face recognition and clustering," in Proc. of Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015.

Cited by

  1. Linear Discriminative Learning for Image Classification vol.2019, pp.None, 2018, https://doi.org/10.1155/2019/4760614