{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,6]],"date-time":"2024-10-06T04:17:28Z","timestamp":1728188248080},"reference-count":25,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"In order to realize the cooperative localization of multi-unmanned platforms in the GNSS-denied environment, this paper proposes a collaborative SLAM (simultaneous localization and mapping, SLAM) framework based on image feature point matching. Without GNSS, a single unmanned platform UGV and UAV (unmanned ground vehicle, UGV; unmanned aerial vehicle, UAV) equipped with vision and IMU (inertial measurement unit, IMU) sensors can exchange information through data communication to jointly build a three-dimensional visual point map, and determine the relative position of each other through visual-based position re- identification and PnP (Perspective-n-Points, PnP) methods. When any agent can receive reliable GNSS signals, GNSS positioning information will greatly improve the positioning accuracy without changing the positioning algorithm framework. In order to achieve this function, we designed a set of two-stage position estimation algorithms. In the first stage, we used the modified ORB-SLAM3 algorithm for position estimation by fusing visual and IMU information. In the second stage, we integrated GNSS positioning and cooperative positioning information using the factor graph optimization (FGO) algorithm. Our framework consists of an UGV as the central server node and three UAVs carried by the UGV, that will collaborate on space exploration missions. Finally, we simulated the influence of different visibility and lighting conditions on the framework function on the virtual simulation experiment platform built based on ROS (robot operating system, ROS) and Unity3D. The accuracy of the cooperative localization algorithm and the single platform localization algorithm was evaluated. In the two cases of GNSS-denied and GNSS-challenged, the error of co-location reduced by 15.5% and 19.7%, respectively, compared with single-platform independent positioning.<\/jats:p>","DOI":"10.3390\/rs14195055","type":"journal-article","created":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T04:50:01Z","timestamp":1665463801000},"page":"5055","source":"Crossref","is-referenced-by-count":2,"title":["An Aerial and Ground Multi-Agent Cooperative Location Framework in GNSS-Challenged Environments"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-5946-1950","authenticated-orcid":false,"given":"Haoyuan","family":"Xu","sequence":"first","affiliation":[{"name":"School of Automation, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]},{"given":"Chaochen","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]},{"given":"Yuming","family":"Bo","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]},{"given":"Changhui","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, 02430 Masala, Finland"}]},{"given":"Yanxi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]},{"given":"Shijie","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]},{"given":"Weisong","family":"Lai","sequence":"additional","affiliation":[{"name":"School of Materials Science and Engineering, Nanjing University of Science and Technology, No. 200, Xiaolingwei Street, Xuanwu District, Nanjing 210094, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Mourikis, A.I., and Roumeliotis, S.I. (2006, January 15\u201319). A multi-state constraint kalman filter for vision-aided inertial navigation. Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, FL, USA.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual\u2013Inertial, and Multimap SLAM","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Elvira, R., Tardos, J.D., and Montiel, J. (2019). ORBSLAM-Atlas: A robust and accurate multi-map system. arXiv.","DOI":"10.1109\/IROS40897.2019.8967572"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1109\/TRO.2012.2189497","article-title":"Robust Place Recognition with Stereo Sequences","volume":"28","author":"Cadena","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989522"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1177\/0278364920948594","article-title":"A resource-aware approach to collaborative loop-closure detection with provable performance guarantees","volume":"40","author":"Tian","year":"2021","journal-title":"Int. J. Robot. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Giamou, M., Khosoussi, K., and How, J.P. (2018, January 21\u201325). Talk Resource-Efficiently to Me: Optimal Communication Planning for Distributed Loop Closure Detection. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460783"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/LRA.2017.2650153","article-title":"Efficient Decentralized Visual Place Recognition Using a Distributed Inverted Index","volume":"2","author":"Cieslewski","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chang, Y., Tian, Y., How, J.P., and Carlone, L. (June, January 30). Kimera-Multi: A System for Distributed Multi-Robot Metric-Semantic Simultaneous Localization and Mapping. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561090"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1109\/LRA.2020.2967681","article-title":"DOOR-SLAM: Distributed, Online, and Outlier Resilient SLAM for Robotic Teams","volume":"5","author":"Lajoie","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1286","DOI":"10.1177\/0278364917732640","article-title":"Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models","volume":"36","author":"Choudhary","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/TPAMI.2012.104","article-title":"Coslam: Collaborative visual slam in dynamic environments","volume":"35","author":"Zou","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1002\/rob.21854","article-title":"CCM-SLAM: Robust and efficient centralized collaborative monocular simultaneous localization and mapping for robotic teams","volume":"36","author":"Schmuck","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2762","DOI":"10.1109\/LRA.2018.2837226","article-title":"CVI-SLAM\u2014Collaborative visual-inertial SLAM","volume":"3","author":"Karrer","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Liu, J., Liu, R., Chen, K., Zhang, J., and Guo, D. (June, January 30). Collaborative Visual Inertial SLAM for Multiple Smart Phones. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561946"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Schmuck, P., Ziegler, T., Karrer, M., Perraudin, J., and Chli, M. (2021, January 4\u20138). COVINS: Visual-Inertial SLAM for Centralized Collaboration. Proceedings of the 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Bari, Italy.","DOI":"10.1109\/ISMAR-Adjunct54149.2021.00043"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Moafipoor, S., Bock, L., Fayman, J.A., and Conroy, E. (2020, January 22\u201325). Vision-Based Collaborative Navigation for UAV-UGV-Dismounted Units in GPS Challenged Environments. Proceedings of the 33rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2020), Online.","DOI":"10.33012\/2020.17684"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fankhauser, P., Bloesch, M., Kr\u00fcsi, P., Diethelm, R., Wermelinger, M., Schneider, T., Dymczyk, M., Hutter, M., and Siegwart, R. (2016, January 9\u201314). Collaborative navigation for flying and walking robots. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759443"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.autcon.2018.11.024","article-title":"Framework for automated registration of UAV and UGV point clouds using local features in images","volume":"98","author":"Park","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1109\/TVT.2018.2890416","article-title":"Autonomous Exploration and Mapping System Using Heterogeneous UAVs and UGVs in GPS-Denied Environments","volume":"68","author":"Qin","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., and Ng, A.Y. (2009, January 12\u201317). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.","DOI":"10.1109\/MRA.2010.936956"},{"key":"ref_22","unstructured":"Song, Y., Naji, S., Kaufmann, E., Loquercio, A., and Scaramuzza, D. (2020). Flightmare: A flexible quadrotor simulator. arXiv."},{"key":"ref_23","unstructured":"Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Sendai, Japan. (IEEE Cat. No. 04CH37566)."},{"key":"ref_24","unstructured":"Zhou, Z., Mertikopoulos, P., Bambos, N., Glynn, P.W., and Tomlin, C. (2017). Countering feedback delays in multi-agent learning. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.automatica.2016.05.007","article-title":"Cooperative pursuit with Voronoi partitions","volume":"72","author":"Zhou","year":"2016","journal-title":"Automatica"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/19\/5055\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,5]],"date-time":"2024-10-05T14:56:15Z","timestamp":1728140175000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/19\/5055"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":25,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["rs14195055"],"URL":"http:\/\/dx.doi.org\/10.3390\/rs14195055","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,10,10]]}}}
