Abstract
In modern healthcare, sensing technologies such as IoT empower the quality of assisted living service by knowing what a resident is doing in real-time. Using extreme connectivity and cloud computing in a smart home, where a collection of sensors is installed, the sensors sample continuously from the movements of the resident as well as ambient data from the surrounding inside the house. Automatic human activity recognition of the resident's activities is one of the key components of assisted living in smart home. For monitoring in-home safety, the ability in recognizing abnormal activities such as accident, falling, acute disease attack (e.g. asthma, stroke, etc.), fainting, wobbling, is particularly important. The detection and machine learning process must be both accurate and fast, to cope with the real-time activity recognition. To this end, a novel streamlined sensor data processing method is proposed called Evolutionary Expand-and-Contract Instance-based Learning algorithm (EEAC-IBL). The multivariate data stream is first expanded into many subspaces, then the subspaces which are corresponding to the characteristics of the features are selected and condensed into a significant feature subset. The selection operates scholastically instead of deterministically by evolutionary optimization which approximates the best subgroup. Followed by data stream mining, the machine learning for activity recognition is done on the fly. This approach is unique and suitable for such extreme connectivity scenario where precise feature selection is not required, and the relative importance of each feature among the sensor data changes over time. This stochastic approximation method is fast and accurate, offering an alternative to traditional machine learning method for smart home activity recognition application. Our experimental results show computing advantages over other classical approaches.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Roy N, Misra A, Cook D (2016) Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments. J Ambient Intell Human Comput 7:1–19. https://doi.org/10.1007/s12652-015-0294-7
Sriram RD, Sheth A (2015) Internet of things perspectives. IT Prof 17(3):60–63
Mizuno H, Nagai H, Sasaki K, Hosaka H, Sugimoto C, Khalil K, Tatsuta S (2007) Wearable sensor system for human behavior recognition (first report: basic architecture and behavior prediction method). In: TRANSDUCERS 2007—2007 international solid-state sensors, actuators and microsystems conference, pp 435–438
Jalal A, Kim Y, Kamal S, Farooq A, Kim D (2015) Human daily activity recognition with joints plus body features representation using Kinect sensor. In: 2015 international conference on informatics, electronics and vision (ICIEV), pp 1–6
Ahad MAR, Antar AD, Ahmed M, IoT sensor-based activity recognition. Springer, ISBN 978–3–030–51378–8
Bilal M, Shaikh FK, Arif M et al (2019) A revised framework of machine learning application for optimal activity recognition. Cluster Comput 22:7257–7273. https://doi.org/10.1007/s10586-017-1212-x
Suto J, Oniga S, Lung C et al (2018) Comparison of offline and real-time human activity recognition results using machine learning techniques. Neural Comput Appl. https://doi.org/10.1007/s00521-018-3437-x
Dash Y, Kumar S, Patle VK (2016) A novel data mining scheme for smartphone activity recognition by accelerometer sensor. In: Das S, Pal T, Kar S, Satapathy S, Mandal J (eds) Proceedings of the 4th international conference on frontiers in intelligent computing: theory and applications (FICTA) 2015. Advances in intelligent systems and computing, vol 404. Springer, New Delhi. https://doi.org/https://doi.org/10.1007/978-81-322-2695-6_12
Li F, Shirahama K, Nisar MA, Huang X, Grzegorzek M (2020) Deep transfer learning for time series data based on sensor modality classification. Sensors 20:4271
Sawada Y, Sato Y, Nakada T, Yamaguchi S, Ujimoto K, Hayashi N (2019) Improvement in classification performance based on target vector modification for all-transfer deep learning. Appl Sci 9:128
Ding R, Li X, Nie L, Li J, Si X, Chu D, Liu G, Zhan D (2019) Empirical study and improvement on deep transfer learning for human activity recognition. Sensors 19:57
Boukli Hacene G, Gripon V, Farrugia N, Arzel M, Jezequel M (2018) Transfer incremental learning using data augmentation. Appl Sci 8:2512
Sajjad M, Zahir S, Ullah A et al (2020) Human behavior understanding in big multimedia data using CNN based facial expression recognition. Mobile Netw Appl 25:1611–1621. https://doi.org/10.1007/s11036-019-01366-9
Vandersmissen B, Knudde N, Jalalvand A et al (2020) Indoor human activity recognition using high-dimensional sensors and deep neural networks. Neural Comput Appl 32:12295–12309. https://doi.org/10.1007/s00521-019-04408-1
Fong S, Liu K, Cho K et al (2016) Improvised methods for tackling big data stream mining challenges: case study of human activity recognition. J Supercomput 72:3927–3959. https://doi.org/10.1007/s11227-016-1639-5
Fong S et al (2018) Performance evaluation of shadow features as a data preprocessing method in data mining for human activities recognitions. In: Wong R, Chi CH, Hung P (eds) Behavior engineering and applications. International series on computer entertainment and media technology. Springer, Cham. https://doi.org/10.1007/978-3-319-76430-6_2
Ahlawat K, Singh AP (2020) Human activity recognition in imbalanced big data using fuzzy rule-based classification system. In: Reddy V, Prasad V, Wang J, Reddy K (eds) Soft computing and signal processing. ICSCSP 2019. Advances in intelligent systems and computing, vol 1118. Springer, Singapore. https://doi.org/10.1007/978-981-15-2475-2_4
Amezzane I, Fakhri Y, El Aroussi M, Bakhouya M (2018) Analysis and effect of feature selection over smartphone-based dataset for human activity recognition. In: Belqasmi F, Harroud H, Agueh M, Dssouli R, Kamoun F (eds) Emerging technologies for developing countries. AFRICATEK 2017. Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering, vol 206. Springer, Cham. https://doi.org/10.1007/978-3-319-67837-5_20
Gopalakrishnan N, Krishnan V, Gopalakrishnan V (2020) Ensemble feature selection to improve classification accuracy in human activity recognition. In: Ranganathan G, Chen J, Rocha Á (eds) Inventive communication and computational technologies. Lecture notes in networks and systems, vol 89. Springer, Singapore. https://doi.org/10.1007/978-981-15-0146-3_51
Guha S, Koudas N (2002) Approximating a data stream for querying and estimation: algorithms and performance evaluation. In: Proceedings 18th international conference on data engineering, San Jose, CA, USA, pp 567–576. https://doi.org/10.1109/ICDE.2002.994775
Lee S-M, Yoon SM, Cho H (2017) Human activity recognition from accelerometer data using convolutional neural network. In: 2017 IEEE international conference on big data and smart computing (BigComp), Jeju, pp 131–134. https://doi.org/10.1109/BIGCOMP.2017.7881728
Babiker M, Khalifa OO, Htike KK, Hassan A, Zaharadeen M (2017) Automated daily human activity recognition for video surveillance using neural network. In: 2017 IEEE 4th international conference on smart instrumentation, measurement and application (ICSIMA), Putrajaya, pp 1–5. https://doi.org/10.1109/ICSIMA.2017.8312024
Goel A, Abubakr A, Koperski M, Bremond F, Francesca G (2018) Online temporal detection of daily-living human activities in long untrimmed video streams. In: 2018 IEEE international conference on image processing, applications and systems (IPAS), Sophia Antipolis, France, pp 43–48. https://doi.org/10.1109/IPAS.2018.8708880
Jianqin Y, Guohui T, Xinran W (2012) Human activity recognition based on event histogram and KL transform. In: Proceedings of the 31st Chinese control conference, Hefei, pp 3912–3916
Yang J, Cheng J, Lu H (2009) Human activity recognition based on the blob features. In: 2009 IEEE international conference on multimedia and expo, New York, NY, pp 358–361. https://doi.org/10.1109/ICME.2009.5202508.
Zhang Y, An H, Ma H, Wei Q, Wang J (2018) Human activity recognition with discrete cosine transform in lower extremity exoskeleton. In: 2018 IEEE international conference on intelligence and safety for robotics (ISR), Shenyang, pp 309–312. https://doi.org/10.1109/IISR.2018.8535705
Pathan NS, Talukdar MTF, Quamruzzaman M, Fattah SA (2019) A machine learning based human activity recognition during physical exercise using wavelet packet transform of PPG and inertial sensors data. In: 2019 4th international conference on electrical information and communication technology (EICT), Khulna, Bangladesh, pp 1–5. https://doi.org/10.1109/EICT48899.2019.9068768
He Z (2010) Activity recognition from accelerometer signals based on Wavelet-AR model. In: 2010 IEEE international conference on progress in informatics and computing, Shanghai, pp 499–502. https://doi.org/10.1109/PIC.2010.5687572
Tian Y, Wang X, Yang P, Wang J, Zhang J (2018) A single accelerometer-based robust human activity recognition via wavelet features and ensemble feature selection. In: 2018 24th international conference on automation and computing (ICAC), Newcastle upon Tyne, UK, pp 1–6. https://doi.org/10.23919/IConAC.2018.8749005
Zhou ZH (2007) Mining ambiguous data with multi-instance multi-label representation. In: Alhajj R, Gao H, Li J, Li X, Zaïane OR (eds) Advanced data mining and applications. ADMA 2007. Lecture notes in computer science, vol 4632. Springer, Berlin. https://doi.org/10.1007/978-3-540-73871-8_1
Lange S, Watson P (1994) Machine discovery in the presence of incomplete or ambiguous data. In: Arikawa S, Jantke KP (eds) Algorithmic learning theory. AII 1994, ALT 1994. Lecture notes in computer science (lecture notes in artificial intelligence), vol 872. Springer, Berlin. https://doi.org/10.1007/3-540-58520-6_82
Babenko B (2008) Multiple instance learning: algorithms and applications. View Article PubMed/NCBI Google Scholar
Guindon S, Gascuel O (2019) Numerical optimization techniques in maximum likelihood tree inference. In: Warnow T (ed) Bioinformatics and phylogenetics. Computational biology, vol 29. Springer, Cham. https://doi.org/10.1007/978-3-030-10837-3_2
Wu X, Kumar V, Quinlan JR, Ghosh J, Yang Q, Motoda H, McLachlan GJ, Ng A, Liu B, Philip SY, Zhou ZH (2008) Top 10 algorithms in data mining. Knowl Inf Syst 14(1):1–37. https://doi.org/10.1007/s10115-007-0114-2.ISSN0219-3116
Cook D (2012) Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 27(1):32–38
Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 11:1601–1604
Domingos P, Hulten G (2000) Mining high-speed data streams. In: Proceedings KDD 2000. ACM Press, New York, pp 71–80
Yang H, Fong S (2011) Optimized very fast decision tree with balanced classification accuracy and compact tree size. In: The 3rd international conference on data mining and intelligent information technology applications, Macao, pp 57–64
Fong S, Biuk-Aghai RP, Millham RC (2018) Swarm search methods in weka for data mining. In: ICMLC 2018: proceedings of the 2018 10th international conference on machine learning and computing, pp 122–127
Piao Y, Ryu KH (2017) A hybrid feature selection method based on symmetrical uncertainty and support vector machine for high-dimensional data classification. In: Nguyen N, Tojo S, Nguyen L, Trawiński B (eds) Intelligent information and database systems. ACIIDS 2017. Lecture notes in computer science, vol 10191. Springer, Cham. https://doi.org/10.1007/978-3-319-54472-4_67
Fong S, Wong R, Vasilakos AV (2016) Accelerated PSO swarm search feature selection for data stream mining big data. IEEE Trans Serv Comput 9(1):33–45. https://doi.org/10.1109/TSC.2015.2439695
Fong S, Liang J, Siu SW, Chan JH (2015) Efficient variation-based feature selection for medical data classification. J Med Imaging Health Inf 5(5):1093–1098
Acknowledgements
The authors are thankful for the financial support from the research grants, MYRG2016-00069, entitled ’Nature-Inspired Computing and Metaheuristics Algorithms for Optimizing Data stream mining Performance’, EF003/FST-FSJ/2019/GSTIC, code no. 201907010001, FDCT/126/2014/A3, entitled ‘A Scalable Data Stream Mining Methodology: Stream-based Holistic Analytics and Reasoning in Parallel’ offered by FDCT and RDAO/FST, the University of Macau and the Macau SAR government.
Author information
Authors and Affiliations
Contributions
Conceptualization, S. H. and S. F.; Data curation, S. H.; Investigation, R. C. M.; Methodology, K.C. and S. F; Resources, S. H., R. C. M. and S. F.; Software, S. H. and S. F.; Supervision, J. F.; Validation, J. F. and K. C.; Visualization, W. S.; Writing – original draft, S. H.; Writing – review & editing, S. F., R. C. M, W. S., J. F. and K. C. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Rights and permissions
About this article
Cite this article
Hu, S., Fong, S., Song, W. et al. Novel evolutionary-EAC instance-learning-based algorithm for fast data stream mining in assisted living with extreme connectivity. Computing 103, 1519–1543 (2021). https://doi.org/10.1007/s00607-020-00899-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-020-00899-2