{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T05:07:11Z","timestamp":1725167231957},"reference-count":36,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T00:00:00Z","timestamp":1581984000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&D Program of China","award":["2017YFF0206602"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Microsoft Kinect, a low-cost motion capture device, has huge potential in applications that require machine vision, such as human-robot interactions, home-based rehabilitation and clinical assessments. The Kinect sensor can track 25 key three-dimensional (3D) \u201cskeleton\u201d joints on the human body at 30 frames per second, and the skeleton data often have acceptable accuracy. However, the skeleton data obtained from the sensor sometimes exhibit a high level of jitter due to noise and estimation error. This jitter is worse when there is occlusion or a subject moves slightly out of the field of view of the sensor for a short period of time. Therefore, this paper proposed a novel approach to simultaneously handle the noise and error in the skeleton data derived from Kinect. Initially, we adopted classification processing to divide the skeleton data into noise data and erroneous data. Furthermore, we used a Kalman filter to smooth the noise data and correct erroneous data. We performed an occlusion experiment to prove the effectiveness of our algorithm. The proposed method outperforms existing techniques, such as the moving mean filter and traditional Kalman filter. The experimental results show an improvement of accuracy of at least 58.7%, 47.5% and 22.5% compared to the original Kinect data, moving mean filter and traditional Kalman filter, respectively. Our method provides a new perspective for Kinect data processing and a solid data foundation for subsequent research that utilizes Kinect.<\/jats:p>","DOI":"10.3390\/s20041119","type":"journal-article","created":{"date-parts":[[2020,2,20]],"date-time":"2020-02-20T08:20:03Z","timestamp":1582186803000},"page":"1119","source":"Crossref","is-referenced-by-count":14,"title":["A Novel Method of Human Joint Prediction in an Occlusion Scene by Using Low-Cost Motion Capture Technique"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-7944-1276","authenticated-orcid":false,"given":"Jianwei","family":"Niu","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, China"}]},{"given":"Xiai","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, China"}]},{"given":"Dan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, China"}]},{"given":"Linghua","family":"Ran","sequence":"additional","affiliation":[{"name":"China National Institute of Standardization, Beijing 100191, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lasota, P.A., and Shah, J.A. (June, January 29). A Multiple-Predictor Approach to Human Motion Prediction. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, Singapore.","DOI":"10.1109\/ICRA.2017.7989265"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1016\/j.robot.2013.05.008","article-title":"Applied ontologies and standards for service robots","volume":"61","author":"Haidegger","year":"2013","journal-title":"Rob. Autom. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Habib, M.K., Baudoin, Y., and Nagata, F. (2011, January 7\u201310). Robotics for rescue and risky intervention. Proceedings of the 37th Annual Conference of the IEEE Industrial Electronics Society (IECON 2011), Melbourne, VIC, Australia.","DOI":"10.1109\/IECON.2011.6119841"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.cirpj.2009.12.001","article-title":"Automotive assembly technologies review: challenges and outlook for a flexible and adaptive approach","volume":"2","author":"Michalos","year":"2010","journal-title":"CIRP J. Manuf. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.matpr.2019.06.702","article-title":"Gesture controlled dual six axis robotic arms with rover using MPU","volume":"21","author":"Prakash","year":"2019","journal-title":"Mater. Today Proc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.robot.2019.02.015","article-title":"A service assistant combining autonomous robotics, flexible goal formulation, and deep-learning-based brain\u2013computer interfacing","volume":"116","author":"Kuhner","year":"2019","journal-title":"Rob. Autom. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.robot.2016.05.004","article-title":"Service robots: System design for tracking people through data fusion and initiating interaction with the human group by inferring social situations","volume":"83","author":"Tseng","year":"2016","journal-title":"Rob. Autom. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.robot.2019.03.005","article-title":"A Survey of Knowledge Representation in Service Robotics","volume":"118","author":"Paulius","year":"2019","journal-title":"Rob. Autom. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.irbm.2018.10.010","article-title":"A Framework for Service Robots in Smart Home: An Efficient Solution for Domestic Healthcare","volume":"39","author":"Ramoly","year":"2018","journal-title":"IRBM"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tseng, R.Y., and Do, E.Y.L. (2010, January 11\u201312). Facial Expression Wonderland: A Novel Design Prototype of Information and Computer Technology for Children with Autism Spectrum Disorder. Proceedings of the 1st ACM International Health Informatics Symposium (IHI 2010), Arlington, VA, USA.","DOI":"10.1145\/1882992.1883064"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2851","DOI":"10.1016\/j.sbspro.2010.03.427","article-title":"Strategies used by elementary schoolchildren solving robotics-based complex tasks: innovative potential of technology","volume":"2","author":"Blanchard","year":"2010","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nergui, M., Imamoglu, N., Yoshida, Y., Gonzalez, J., Sekine, M., Kawamura, K., and Yu, W.W. (2013). Human Behavior Recognition by a Mobile Robot Following Human Subjects. Evaluating AAL Systems Through Competitive Benchmarking, Springer.","DOI":"10.1007\/978-3-642-37419-7_13"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/j.physio.2013.03.001","article-title":"Affordable clinical gait analysis: An assessment of the marker tracking accuracy of a new low-cost optical 3d motion analysis system","volume":"99","author":"Carse","year":"2013","journal-title":"Physiotherapy"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"274","DOI":"10.3109\/03091902.2014.909540","article-title":"Comparative Abilities of Microsoft Kinect and Vicon 3D Motion Capture for Gait Analysis","volume":"38","author":"Pfister","year":"2014","journal-title":"J. Med. Eng. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.patcog.2010.08.021","article-title":"Skeleton Growing and Pruning with Bending Potential Ratio","volume":"44","author":"Shen","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kean, S., Hall, J., and Perry, P. (2011). Meet the Kinect: An Introduction to Programming Natural User Interfaces, Apress.","DOI":"10.1007\/978-1-4302-3889-8"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tripathy, S.R., Chakravarty, K., Sinha, A., Chatterjee, D., and Saha, S.K. (2017, January 28\u201331). Constrained Kalman Filter For Improving Kinect Based Measurements. Proceedings of the 2017 IEEE International Symposium on Circuits and Systems (ISCAS), Baltimore, MD, USA.","DOI":"10.1109\/ISCAS.2017.8050664"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"035002","DOI":"10.1088\/2057-1976\/aaa371","article-title":"Improving joint position estimation of Kinect using anthropometric constraint based adaptive Kalman filter for rehabilitation","volume":"4","author":"Das","year":"2018","journal-title":"Biomed. Phys. Eng. Express"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.gaitpost.2018.11.029","article-title":"Three-dimensional cameras and skeleton pose tracking for physical function assessment: A review of uses, validity, current developments and Kinect alternatives","volume":"68","author":"Clark","year":"2019","journal-title":"Gait Posture"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s10665-014-9689-2","article-title":"Application of extended Kalman filter for improving the accuracy and smoothness of Kinect skeleton-joint estimates","volume":"88","author":"Shu","year":"2014","journal-title":"J. Eng. Math."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1016\/j.gaitpost.2019.03.020","article-title":"Reliability and validity of the Kinect V2 for the assessment of lower extremity rehabilitation exercises","volume":"70","author":"Wochatz","year":"2019","journal-title":"Gait Posture"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3038","DOI":"10.1016\/j.ijmedinf.2018.11.001","article-title":"Clinical assessment of depth sensor based pose estimation algorithms for technology supervised rehabilitation applications","volume":"121","author":"Sarsfield","year":"2019","journal-title":"Int. J. Med. Informatics"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.apergo.2017.02.015","article-title":"Real time RULA assessment using Kinect v2 sensor","volume":"65","author":"Manghisi","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.apergo.2017.04.004","article-title":"Using the Microsoft Kinect\u2122 to assess 3-D shoulder kinematics during computer use","volume":"65","author":"Xu","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1016\/j.apergo.2016.10.015","article-title":"Validation of an ergonomic assessment method using Kinect data in real workplace conditions","volume":"65","author":"Plantard","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Edwards, M., and Green, R. (2014, January 19\u201321). Low-latency filtering of kinect skeleton data for video game control. Proceedings of the 29th International Conference on Image and Vision Computing New Zealand, Hamilton, New Zealand.","DOI":"10.1145\/2683405.2683453"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.rcim.2013.09.003","article-title":"Markerless Human-Robot Interface for Dual Robot Manipulators Using Kinect Sensor","volume":"30","author":"Du","year":"2014","journal-title":"Rob. Comput. Integr. Manuf."},{"key":"ref_28","first-page":"585","article-title":"A Kinect-Based Motion Capture System for Robotic Gesture Imitation","volume":"Volume 1","author":"Rosado","year":"2014","journal-title":"ROBOT 2013: First Iberian Robotics Conference"},{"key":"ref_29","unstructured":"Wang, Q.F., Kurillo, G., Ofli, F., and Bajcsy, R. (2020, January 01). Remote Health Coaching System and Human Motion Data Analysis for Physical Therapy with Microsoft Kinect. Available online: https:\/\/arxiv.org\/abs\/1512.06492."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Shen, W., Deng, K., Bai, X., Leyvand, T., Guo, B.N., and Tu, Z.W. (2012, January 16\u201321). Exemplar-Based Human Action Pose Correction and Tagging. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247875"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/TCYB.2013.2275945","article-title":"Real-Time Posture Reconstruction for Microsoft Kinect","volume":"43","author":"Shum","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2437","DOI":"10.1109\/TVCG.2015.2510000","article-title":"Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models","volume":"22","author":"Liu","year":"2016","journal-title":"IEEE Trans. Visual Comput. Graphics"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4291","DOI":"10.1007\/s11042-016-3546-4","article-title":"Filtered Pose Graph for Efficient Kinect Pose Reconstruction","volume":"76","author":"Plantard","year":"2017","journal-title":"Multimedia Tools Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/BF00236911","article-title":"Spatial Control of Arm Movements","volume":"42","author":"Morasso","year":"1981","journal-title":"Exp. Brain Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1016\/j.physio.2015.02.002","article-title":"Validity and Reliability of Kinect Skeleton for Measuring Shoulder Joint Angles: A Feasibility Study Chartered Society of Physiotherapy","volume":"101","author":"Huber","year":"2015","journal-title":"Physiotherapy"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2821","DOI":"10.1109\/TPAMI.2012.241","article-title":"Difficient Human Pose Estimation from Single depth Images","volume":"35","author":"Shotton","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T14:02:45Z","timestamp":1719237765000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,18]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20041119"],"URL":"https:\/\/doi.org\/10.3390\/s20041119","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,18]]}}}
