3D face recognition using photometric stereo and deep learning

Kneis, Bryan; Zhang, Wenhao

Abstract

Illumination variance is one of the largest real-world problems when deploying face recognition systems. Over the last few years much work has gone into the development of novel 3D face recognition methods to overcome this issue. Photometric stereo is a well-established 3D reconstruction technique capable of re-covering the normals and albedo of a surface. Although it provides a way to obtain 3D data, the amount of training data available captured using photometric stereo often does not provide sufficient modelling capacity for training state-of-the-art feature extractors, such as deep convolutional neural networks, from scratch.
In this work we present a novel approach to utilising the lighting apparatus commonly used for photometric stereo to synthesise data that can act as a biometric. Combining this with deep learning techniques not only did we achieve near state-of-the-art results, but it gave insight into the possibility of using photometric stereo without the need of reconstruction. This could not only simplify the face recognition process but avoid unnecessary error that may arise from reconstruction.
Additionally, we utilise the active lighting from photometric stereo to evaluate the effect of illumination on face recognition. We compare our method to the state-of-the-art 3D methods and discuss potential use cases for our system.

Citation

Kneis, B., & Zhang, W. (2020). 3D face recognition using photometric stereo and deep learning. In Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics (255–261). https://doi.org/10.1145/3405962.3405995

• Conference Name: The 10th International Conference on Web intelligence, Mining and Semantics (WIMS)
• Conference Location: Casino Barrière, Biarritz - France
• Start Date: Jun 30, 2020
• End Date: Jul 3, 2020
• Acceptance Date: May 28, 2020
• Online Publication Date: Jun 30, 2020
• Publication Date: Jun 30, 2020
• Deposit Date: Jul 14, 2021
• Publicly Available Date: Jul 15, 2021
• Pages: 255–261
• Book Title: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics
• ISBN: 9781450300000
• DOI: https://doi.org/10.1145/3405962.3405995
• Public URL: https://uwe-repository.worktribe.com/output/6056936