Exemplar Based Convolutional Neural Network for Face Search on CCTV Video Recording

Winda Mauli Kristy, Yaya Wihardi, Erlangga Erlangga

Abstract


Many techniques can perform effective face searches, but generally, these methods require numerous samples, particularly when using deep learning approaches. However, there are scenarios where face searches must be conducted with limited samples, such as those obtained from CCTV video recordings, making prior training infeasible. In these situations, a method based on exemplars must be implemented. This investigation utilizes a convolutional neural network (CNN) approach coupled with two unique matching techniques: cross-correlation matching (CCM) and normalized cross-correlation matching (NCC). The study makes use of the Chokepoint Face Dataset, training the data through the optimization of triplet loss. The goal of the study is to evaluate the performance of these combined methods. Two different architectures are created and tested within each method to determine the accuracy of each architecture. The CNN-NCC method has been found to yield accuracy rates that surpass those of the CNN-CCM method by 2 to 17.9%. Nevertheless, it is important to note that the accuracy of the results is greatly influenced by the variations observed in the CCTV video recordings.

Keywords


CCTV; Convolution Neural Network; Cross-correlation Matching; Normalized Cross-correlation Matching; Exemplar-Based; Face Search; Triplet Loss Optimization

Full Text:

PDF

References


Adem, K. (2022). Impact of activation functions and number of layers on detection of exudates using circular Hough transform and convolutional neural networks. Expert Systems with Applications, 203, 117583.

Bhople, A. R., and Prakash, S. (2021). Learning similarity and dissimilarity in 3D faces with triplet network. Multimedia Tools and Applications, 80(28), 35973-35991.

Cui, Z., Qi, W., and Liu, Y. (2020, December). A fast image template matching algorithm based on normalized cross correlation. In Journal of Physics: Conference Series, 1693(1), 012163.

Davis, J. P., and Valentine, T. (2015). Human verification of identity from photographic images. Forensic facial identification: Theory and practice of identification from eyewitnesses, composites and CCTV, 209-238.

Dunn, J. (2018). Robust search templates for face-in-crowd search (Doctoral dissertation, UNSW Sydney).

EnsarЕ, T., and Günay, M. (2017). Comparison of face recognition algorithms. In 2017 25th Signal Processing and Communications Applications Conference (SIU), 2017, 1-4.

Irshad, M., Zhou, X., Noman, S. M., Murthy, A., Hu, B., Haider, S. A., and Olawale, O. A. (2021). City vision: CCTV images based public surveillance model. In 2021 International Conference on Electronic Information Technology and Smart Agriculture (ICEITSA), 2021, 416-420.

Mileva, M., and Burton, A. M. (2019). Face search in CCTV surveillance. Cognitive Research: Principles and Implications, 4, 1-21.

Parchami, M., Bashbaghi, S., and Granger, E. (2017). Cnns with cross-correlation matching for face recognition in video surveillance using a single training sample per person. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). 2017, 1-6.

Subramaniam, A., Chatterjee, M., and Mittal, A. (2016). Deep neural networks with inexact matching for person re-identification. Advances in Neural Information Processing Systems, 29.

Sumbul, G., Ravanbakhsh, M., and Demir, B. (2021). Informative and representative triplet selection for multilabel remote sensing image retrieval. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-11.

Tudavekar, G., Patil, S. R., and Saraf, S. S. (2021). Dual-tree complex wavelet transform and deep CNN-based super-resolution for video inpainting with application to object removal and error concealment. In Computational Intelligence Methods for Super-Resolution in Image Processing Applications, 2021, 231-248.

Wang, D., Otto, C., and Jain, A. K. (2016). Face search at scale. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1122-1136.

Zhao, W., Du, S., and Emery, W. J. (2017). Object-based convolutional neural network for high-resolution imagery classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10(7), 3386-3396.

Zou, F., Yang, F., Chen, W., Li, K., Song, J., Chen, J., and Ling, H. (2020). Fast large scale deep face search. Pattern Recognition Letters, 130, 83-90.




DOI: https://doi.org/10.17509/jcs.v4i2.71185

Refbacks

  • There are currently no refbacks.