Abstract
In unsupervised person re-identification, the traditional asymmetric metric learning alleviates the bias of person images from different views. However, there still exists the issue that the features of the same person are not close to each other in the feature space after asymmetric metric learning. The main reason is that the algorithm cannot overcome other interference except the view, such as the change in person’s clothes and scenes, etc. Therefore, the traditional asymmetric metric learning still has the issue of distribution differences in feature space. To address this issue, we propose an asymmetric metric learning method based on distribution regularization constraints for unsupervised person re-identification. First, the JSTL technique pretrains the feature extraction network to obtain robust features. Then, a new asymmetric metric objective function is defined, that is, a distributed regularization constraint term is introduced into the traditional asymmetric metric learning objective function. This method not only alleviates the bias caused by different views, but also effectively overcomes the issue of low recognition accuracy caused by the interference of scenes and clothing changes other than views. Finally, the gradient descent method is used to optimize the objective function, and the optimal metric matrix is obtained by solving the generalized eigenvalue problem. Experiments are implemented on VIPeR, CUHK01, Market-1501, DukeMTMC-Reid, and MSMT17 datasets, and the results show that the Rank-1 values of the algorithm are 35.2\(\%\), 52.62\(\%\), 57.1\(\%\), 42.6\(\%\) and 24.5\(\%\). Extensive experimental results show that our algorithm gains significant improvement compared with the state-of-art unsupervised person re-identification algorithms.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bazzani L, Cristani M, Murino V (2013) Symmetry-driven accumulation of local features for human characterization and re-identification. Comput Vision Image Understand 117(2):130–144. https://doi.org/10.1016/j.cviu.2012.10.008
Bedagkar-Gala A, Shah SK (2014) A survey of approaches and trends in person re-identification. Image Vision Comput 32(4):270–286. https://doi.org/10.1016/j.imavis.2014.02.001
Chen D, Wu P, Jia T et al (2022) Hob-net: high-order block network via deep metric learning for person re-identification. Appl Intell 52(5):4844–4857. https://doi.org/10.1007/s10489-021-02450-y
Chen YC, Zheng WS, Lai J et al (2017) An asymmetric distance model for cross-view feature mapping in person re-identification. IEEE Trans Circ Syst Video Technol 27(8):1661–1675. https://doi.org/10.1109/TCSVT.2016.2515309
Chen YC, Zhu X, Zheng WS et al (2017) Person re-identification by camera correlation aware feature augmentation. IEEE Trans Pattern Anal Mach Intell 40(2):392–408. https://doi.org/10.1109/TPAMI.2017.2666805
Chong Y, Peng C, Zhang C et al (2021) Learning domain invariant and specific representation for cross-domain person re-identification. Appl Intell 51(8):5219–5232. https://doi.org/10.1007/S10489-020-02107-2
Deng W, Zheng L, Ye Q, et al (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 994–1003, https://doi.org/10.1109/CVPR.2018.00110
Ding C, He X, Simon HD (2005) On the equivalence of nonnegative matrix factorization and spectral clustering. In: Proceedings of the 2005 SIAM international conference on data mining, pp 606–610, https://doi.org/10.1137/1.9781611972757.70
Fan H, Zheng L, Yan C et al (2018) Unsupervised person re-identification: Clustering and fine-tuning. ACM Trans Multimed Comput Commun Appl (TOMM) 14(4):1–18. https://doi.org/10.1145/3243316
Feng Y, Yuan Y, Lu X (2021) Person reidentification via unsupervised cross-view metric learning. IEEE Transactions on Cybernetics 51(4):1849–1859. https://doi.org/10.1109/TCYB.2019.2909480
Ge Y, Zhu F, Chen D, et al (2020) Self-paced contrastive learning with hybrid memory for domain adaptive object re-id. Adv Neural Inf Process Syst 33:11,309–11,321
He K, Zhang X, Ren S, et al (2016a) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778, https://doi.org/10.1109/CVPR.2016.90
He WX, Chen YC, Lai JH (2016b) Cross-view transformation based sparse reconstruction for person re-identification. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp 3410–3415, https://doi.org/10.1109/ICPR.2016.7900161
Jiao J, Zheng WS, Wu A et al (2018) Deep low-resolution person re-identification. Proceedings of the AAAI Conference on artificial intelligence 1:6967–6974. https://doi.org/10.1609/aaai.v32i1.12284
Kodirov E, Xiang T, Gong S (2015) Dictionary learning with iterative laplacian regularisation for unsupervised person re-identification. In: BMVC, pp 1–8, https://doi.org/10.5244/C.29.44
Lee H, Ekanadham C, Ng A (2007) Sparse deep belief net model for visual area v2. Adv Neural Inf Process Syst 20:873–880
Li J, Lu K, Huang Z et al (2019) Transfer independently together: A generalized framework for domain adaptation. IEEE Trans Cybernet 49(6):2144–2155. https://doi.org/10.1109/TCYB.2018.2820174
Li W, Zhao R, Wang X (2012) Human reidentification with transferred metric learning. In: Asian conference on computer vision, https://doi.org/10.1007/978-3-642-37331-2_3
Li X, Liu L, Lu X (2017) Person reidentification based on elastic projections. IEEE Trans Neural Netw Learn Syst 29(4):1314–1327. https://doi.org/10.1109/TNNLS.2016.2602855
Li Z, Liu H, Zhang Z et al (2021) Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3055147
Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2197–2206, https://doi.org/10.1109/CVPR.2015.7298832
Lin Y, Dong X, Zheng L, et al (2019) A bottom-up clustering approach to unsupervised person re-identification. In: Proceedings of the AAAI conference on artificial intelligence, pp 8738–8745, https://doi.org/10.1609/aaai.v33i01.33018738
Liu H, Wang X, Zhang W et al (2020) Infrared head pose estimation with multi-scales feature fusion on the irhp database for human attention recognition. Neurocomputing 411:510–520. https://doi.org/10.1016/j.neucom.2020.06.066
Liu H, Chen Y, Zhao W et al (2021) Human pose recognition via adaptive distribution encoding for action perception in the self-regulated learning process. Infrared Phys Technol 114(103):660. https://doi.org/10.1016/j.infrared.2021.103660
Liu H, Nie H, Zhang Z et al (2021) Anisotropic angle distribution learning for head pose estimation and attention understanding in human-computer interaction. Neurocomputing 433:310–322. https://doi.org/10.1016/j.neucom.2020.09.068
Liu H, Zheng C, Li D et al (2021) Edmf: Efficient deep matrix factorization with review feature learning for industrial recommender system. IEEE Trans Indust Informat 18(7):4361–4371. https://doi.org/10.1109/TII.2021.3128240
Liu H, Liu T, Chen Y et al (2022) Ehpe: Skeleton cues-based gaussian coordinate encoding for efficient human pose estimation. IEEE Trans Multimed. https://doi.org/10.1109/TMM.2022.3197364
Liu H, Liu T, Zhang Z et al (2022) Arhpe: Asymmetric relation-aware representation learning for head pose estimation in industrial human-computer interaction. IEEE Trans Indust Informat 18(10):7107–7117. https://doi.org/10.1109/TII.2022.3143605
Liu H, Zheng C, Li D et al (2022) Multi-perspective social recommendation method with graph representation learning. Neurocomputing 468:469–481. https://doi.org/10.1016/j.neucom.2021.10.050
Liu T, Wang J, Yang B et al (2021) Ngdnet: Nonuniform gaussian-label distribution learning for infrared head pose estimation and on-task behavior understanding in the classroom. Neurocomputing 436:210–220. https://doi.org/10.1016/j.neucom.2020.12.090
Peng P, Xiang T, Wang Y, et al (2016) Unsupervised cross-dataset transfer learning for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1306–1315, https://doi.org/10.1109/CVPR.2016.146
Qin C, Song S, Huang G et al (2015) Unsupervised neighborhood component analysis for clustering. Neurocomputing 168:609–617. https://doi.org/10.1016/j.neucom.2015.05.064
Si S, Tao D, Geng B (2010) Bregman divergence-based regularization for transfer subspace learning. IEEE Trans Knowl Data Eng 22(7):929–942. https://doi.org/10.1109/TKDE.2009.126
Tay CP, Roy S, Yap KH (2019) Aanet: Attribute attention network for person re-identifications. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7134–7143, https://doi.org/10.1109/CVPR.2019.00730
Vedaldi A, Lenc K (2015) Matconvnet: Convolutional neural networks for matlab. In: Proceedings of the 23rd ACM international conference on Multimedia, pp 689–692, https://doi.org/10.1145/2733373.2807412
Wang H, Zhu X, Xiang T, et al (2016) Towards unsupervised open-set person re-identification. In: 2016 IEEE International conference on image processing (ICIP), IEEE, pp 769–773, https://doi.org/10.1109/ICIP.2016.7532461
Wang J, Zhu X, Gong S, et al (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2275–2284, https://doi.org/10.1109/cvpr.2018.00242
Wei L, Zhang S, Gao W, et al (2018) Person transfer gan to bridge domain gap for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 79–88, https://doi.org/10.1109/CVPR.2018.00016
Xiao T, Li H, Ouyang W, et al (2016) Learning deep feature representations with domain guided dropout for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1249–1258, https://doi.org/10.1109/CVPR.2016.140
Yang Q, Yu HX, Wu A, et al (2019) Patch-based discriminative feature learning for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3633–3642, https://doi.org/10.1109/CVPR.2019.00375
Ye J, Zhao Z, Liu H (2007) Adaptive distance metric learning for clustering. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp 1–7, https://doi.org/10.1109/CVPR.2007.383103
Ye M, Shen J, Lin G et al (2021) Deep learning for person re-identification: A survey and outlook. IEEE Trans Pattern Anal Mach Intell 44(6):2872–2893. https://doi.org/10.1109/TPAMI.2021.3054775
Yu HX, Wu A, Zheng WS (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 994–1002, https://doi.org/10.1109/iccv.2017.113
Yu HX, Wu A, Zheng WS (2018) Unsupervised person re-identification by deep asymmetric metric embedding. IEEE Trans Pattern Anal Mach Intell 42(4):956–973. https://doi.org/10.1109/TPAMI.2018.2886878
Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: A benchmark. In: Proceedings of the IEEE international conference on computer vision, pp 1116–1124, https://doi.org/10.1109/ICCV.2015.133
Zheng Y, Zhou Y, Zhao J et al (2022) Clustering matters: Sphere feature for fully unsupervised person re-identification. ACM Trans Multimed Comput Commun Appl (TOMM) 18(4):1–18. https://doi.org/10.1145/3501404
Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: Proceedings of the IEEE international conference on computer vision, pp 3754–3762, https://doi.org/10.1109/ICCV.2017.405
Zhu JY, Park T, Isola P, et al (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp 2223–2232, https://doi.org/10.1109/cvpr.2018.00242
Zou G, Fu G, Peng X, et al (2021) Person re-identification based on metric learning: a survey. Multimedia Tools and Applications 80(17):26,855–26,888. https://doi.org/10.1007/s11042-021-10953-6
Acknowledgements
This work is supported by the Shandong provincial Natural Science Foundation (No.ZR2022MF307), the Shandong University of Technology and Zhangdian District (No.118228), the National Natural Science Foundation of China (No.61801272).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, Y., Zou, G., Chen, G. et al. Unsupervised person re-identification based on distribution regularization constrained asymmetric metric learning. Appl Intell 53, 28879–28894 (2023). https://doi.org/10.1007/s10489-023-05067-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-023-05067-5