Abstract
Person reidentification, i.e., retrieving a person of interest across several non-overlapping cameras, is a task that is far from trivial. Despite its great commercial value and wide range of applications (e.g., surveillance, intelligent environments, forensics, service robotics, marketing), it remains unsolved, even when the individuals do not change clothes during the recognition period. This paper provides an outlook on long-term person reidentification, an emerging research topic regarding when consecutive acquisitions of an individual can be found apart for days or even months, making such a task even more challenging. A long-term reidentification system using face recognition is presented to emphasize current techniques’ limitations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baabou, S., et al.: A study of person re-identification system. Am. J. Eng. Rese. (AJER) 7, 210–218 (2018)
Bansal, A., et al.: The do’s and don’ts for CNN-based face verification. In: Proceedings of IEEE International Conference on Computer Vision Workshops (2017)
Barbosa, I.B., et al.: Looking beyond appearances: synthetic training data for deep CNNs in re-identification. Comput. Vis. Image Understand. 167, 50–62 (2018)
Bedagkar-Gala, A., Shah, S.K.: A survey of approaches and trends in person re-identification. Image Vis. Comput. 32, 270–286 (2014)
Bird, N.D., et al.: Detection of loitering individuals in public transportation areas. IEEE Trans. Intell. Transp. Syst. 6, 167–177 (2005)
Bobeldyk, D., Ross, A.: Predicting soft biometric attributes from 30 pixels: a case study in NIR ocular images. In: IEEE Winter Applications of Computer Vision Workshops (2019)
Bondi, E., Pala, P., Seidenari, L., Berretti, S., Del Bimbo, A.: Long term person re-identification from depth cameras using facial and skeleton data. In: Wannous, H., Pala, P., Daoudi, M., Flórez-Revuelta, F. (eds.) UHA3DS 2016. LNCS, vol. 10188, pp. 29–41. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91863-1_3
Bucak, S.S., et al.: Efficient multi-label ranking for multi-class learning: Application to object recognition. In: IEEE International Conference on Computer Vision (2009)
Cao, Q., et al.: VGGFace2: a dataset for recognising faces across pose and age. In: Proceedings of 13th IEEE International Conference on Automatic Face and Gesture Recognition (2018)
Dollár, P., et al.: Fast feature pyramids for object detection. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1532–1545 (2014)
Esler, T.: Face recognition using PyTorch (2020)
Geng, X., et al.: Individual stable space: an approach to face recognition under uncontrolled conditions. IEEE Trans. Neural Netw. 19, 1354–1368 (2008)
Gheissari, N., et al.: Person reidentification using spatiotemporal appearance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006)
Gou, M., et al.: Person re-identification in appearance impaired scenarios. In: Proceedings of the British Machine Vision Conference 2016 (2016)
Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5302, pp. 262–275. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88682-2_21
Han, F., et al.: Space-time representation of people based on 3D skeletal data: a review. Comput. Vis. Image Underst. 158, 85–105 (2017)
Har-Peled, S., et al.: Constraint classification for multiclass classification and ranking. In: Advances in Neural Information Processing Systems (2002)
Hasan, M., Babaguchi, N.: Long-term people reidentification using anthropometric signature. In: IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS) (2016)
Hirzer, M., Beleznai, C., Roth, P.M., Bischof, H.: Person re-identification by descriptive and discriminative classification. In: Heyden, A., Kahl, F. (eds.) SCIA 2011. LNCS, vol. 6688, pp. 91–102. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21227-7_9
Hoang, V.T., et al.: 3-D facial landmarks detection for intelligent video systems. IEEE Trans. Ind. Inform. 17, 578–586 (2021)
Hofmann, M., et al.: The TUM Gait from Audio, Image and Depth (GAID) database: multimodal recognition of subjects and traits. J. Vis. Commun. Image Represent. 25, 195–206 (2014)
Hu, C.H., et al.: Face illumination recovery for the deep learning feature under severe illumination variations. Pattern Recogn. 111, 107724 (2021)
Huang, Y., et al.: Celebrities-ReID: a benchmark for clothes variation in long-term person re-identification. In: Proceedings of the International Joint Conference on Neural Networks (2019)
Jayaraman, U., et al.: Recent development in face recognition. Neurocomputing 408, 231–245 (2020)
Karanam, S.: A systematic evaluation and benchmark for person re-identification: features, metrics, and datasets. IEEE Trans. Pattern Anal. Mach. Intell. 41, 523–536 (2019)
Köstinger, M., et al.: Large scale metric learning from equivalence constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)
Krizhevsky, A., et al.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012)
LeCun, Y., Bengio, Y.: Convolutional networks for images, speech, and time-series. In: Handbook of Brain Theory and Neural Networks (1998)
Li, W., Wang, X.: Locally Aligned Feature Transforms across Views. In: IEEE Conference on Computer Vision and Pattern Recognition (2013)
Liu, Z., et al.: Person reidentification by joint local distance metric and feature transformation. IEEE Trans. Neural Netw. Learn. Syst. 30, 2999–3009 (2019)
Lu, J., et al.: Learning compact binary face descriptor for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37, 2041–2056 (2015)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence (1981)
Martinel, N., et al.: Person reidentification in a distributed camera network framework. IEEE Trans. Cybern. 47, 3530–3541 (2017)
Munaro, M., et al.: 3D reconstruction of freely moving persons for re-identification with a depth sensor. In: 2014 IEEE International Conference on Robotics and Automation (ICRA) (2014)
Pala, P., et al.: Enhanced skeleton and face 3D data for person re-identification from depth cameras. Comput. Graph. 79, 69–80 (2019)
Plichoski, G.F., et al.: A face recognition framework based on a pool of techniques and differential evolution. Inf. Sci. 543, 219–224 (2021)
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006). https://doi.org/10.1007/11744023_34
Sang, X., et al.: Nonconvex regularizer and latent pattern based robust regression for face recognition. Inf. Sci. 547, 384–403 (2021)
Satta, R.: Appearance descriptors for person re-identification: a comprehensive review. arXIv (2013)
Schroff, F., et al.: FaceNet: a unified embedding for face recognition and clustering. In: IEEE Conference on Computer Vision and Pattern Recognition (2015)
Schumann, A., Monari, E.: A soft-biometrics dataset for person tracking and re-identification. 11th IEEE International Conference on Advanced Video and Signal-Based Surveillance (2014)
Seide, F., et al.: Feature engineering in Context-Dependent Deep Neural Networks for conversational speech transcription. In: IEEE Workshop on Automatic Speech Recognition and Understanding (2011)
Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition (1994)
Sun, Y., et al.: Deep convolutional network cascade for facial point detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2013)
Szomszor, M., et al.: Identifying research fronts in the web of science: from metrics to meaning. Technical report, Institute for Scientific Information (2020)
Taghipour-Gorjikolaie, M., et al.: Deep adaptive feature enrichment. Expert Syst. Appl. 162, 113780 (2020)
Tao, D., et al.: Person reidentification by minimum classification error-based KISS metric learning. IEEE Trans. Cybern. 45, 242–252 (2015)
Tomasi, C., Kanade, T.: Detection and tracking of point features. Technical report, International Journal of Computer Vision (1991)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57, 137–154 (2004)
Wang, T., et al.: Person re-identification by video ranking (2014)
Wu, D., et al.: Deep learning-based methods for person re-identification: a comprehensive review. Neurocomputing 337, 354–371 (2019)
Wu, F., et al.: Spectrum-aware discriminative deep feature learning for multi-spectral face recognition. Pattern Recogn. 111, 107632 (2021)
Yan, H., Song, C.: Multi-scale deep relational reasoning for facial kinship verification. Pattern Recogn. 110, 107541 (2021)
Zafeiriou, S., et al.: A survey on face detection in the wild: past, present and future. Comput. Vis. Image Underst. 138, 1–24 (2015)
Zhang, K., et al.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23, 1499–1503 (2016)
Zhang, P., et al.: Long-term person re-identification using true motion from videos. In: IEEE Winter Conference on Applications of Computer Vision (2018)
Zhang, P., et al.: Learning spatial-temporal representations over walking tracklet for long-term person re-identification in the wild. IEEE Trans. Multimed. 23, 3562–3576 (2020)
Zhang, Z., et al.: Semi-supervised face frontalization in the wild. IEEE Trans. Inf. Forensics Secur. 16, 909–922 (2021)
Zheng, M., et al.: RPIfield: a new dataset for temporally evaluating person re-identification (2018)
Zhu, X., et al.: face alignment in full pose range: a 3D total solution. CoRR (2018)
Acknowledgements
This work has been financially supported by national grant from the FCT (Fundação para a Ciência e a Tecnologia), under the project UIDB/05567/2020. Diego Haddad would like to thank the Brazillian organization National Council for Scientific and Technological Development (CNPq) for its financial support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Manhães, A. et al. (2022). Long-Term Person Reidentification: Challenges and Outlook. In: Pereira, A.I., Košir, A., Fernandes, F.P., Pacheco, M.F., Teixeira, J.P., Lopes, R.P. (eds) Optimization, Learning Algorithms and Applications. OL2A 2022. Communications in Computer and Information Science, vol 1754. Springer, Cham. https://doi.org/10.1007/978-3-031-23236-7_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-23236-7_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23235-0
Online ISBN: 978-3-031-23236-7
eBook Packages: Computer ScienceComputer Science (R0)