{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,7,23]],"date-time":"2023-07-23T04:13:13Z","timestamp":1690085593682},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2023,8,31]]},"abstract":"Sensor-based human activity recognition aims to recognize the activities performed by people with the sensor readings. Most of existing works in this area rely on supervised classification algorithms, and can only recognize activities covered by the training data. Whereas, in many practical applications, while performing activity recognition, not only the activities covered by the training data, but also some previously unseen activities need to be recognized. In this paper, we study the problem of generalized zero-shot activity recognition. In this problem, the activities that need to be recognized contain both the activities covered by the training data and the previously unseen activities. We firstly give a formulation of this problem, and then propose an embedding-based method to address it. In this method, an embedding-compatibility model is learned. When performing activity recognition, the learned model and the calibrated stacking mechanism are employed. Extensive experiments on publicly available datasets demonstrate the effectiveness of our method.<\/jats:p>","DOI":"10.1145\/3582690","type":"journal-article","created":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T07:24:45Z","timestamp":1675322685000},"page":"1-25","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Generalized Zero-Shot Activity Recognition with Embedding-Based Method"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-7283-8652","authenticated-orcid":false,"given":"Wei","family":"Wang","sequence":"first","affiliation":[{"name":"Qingdao University, Qingdao, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-3698-0808","authenticated-orcid":false,"given":"Qingzhong","family":"Li","sequence":"additional","affiliation":[{"name":"Shandong University, Jinan, China"}]}],"member":"320","published-online":{"date-parts":[[2023,4,5]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3351228"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2487986"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.5220\/0006595204780485"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.108859"},{"key":"e_1_3_2_6_2","first-page":"983","volume-title":"International Conference on Machine Learning","author":"Belanger David","year":"2016","unstructured":"David Belanger and Andrew McCallum. 2016. Structured prediction energy networks. In International Conference on Machine Learning. 983\u2013992."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3494994"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-019-01193-1"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_4"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2015.7350781"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/97"},{"issue":"4","key":"e_1_3_2_12_2","first-page":"77:1\u201377:40","article-title":"Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities","volume":"54","author":"Chen Kaixuan","year":"2021","unstructured":"Kaixuan Chen, Dalin Zhang, Lina Yao, Bin Guo, Zhiwen Yu, and Yunhao Liu. 2021. Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities. Comput. Surveys 54, 4 (2021), 77:1\u201377:40.","journal-title":"Comput. Surveys"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2012.2198883"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.3047546"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00859"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2462456.2464438"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i6.20614"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.06.070"},{"key":"e_1_3_2_19_2","first-page":"6323","volume-title":"Advances in Neural Information Processing Systems","author":"Graber Colin","year":"2018","unstructured":"Colin Graber, Ofer Meshi, and Alexander Schwing. 2018. Deep structured prediction with nonlinear output transformations. In Advances in Neural Information Processing Systems. 6323\u20136334."},{"issue":"8","key":"e_1_3_2_20_2","first-page":"177:1\u2013177:34","article-title":"A survey on deep learning for human activity recognition","volume":"54","author":"Gu Fuqiang","year":"2021","unstructured":"Fuqiang Gu, Mu-Huan Chung, Mark Chignell, Shahrokh Valaee, Baoding Zhou, and Xue Liu. 2021. A survey on deep learning for human activity recognition. Comput. Surveys 54, 8 (2021), 177:1\u2013177:34.","journal-title":"Comput. Surveys"},{"key":"e_1_3_2_21_2","first-page":"1341","volume-title":"International Conference on Machine Learning","author":"Gygli Michael","year":"2017","unstructured":"Michael Gygli, Mohammad Norouzi, and Anelia Angelova. 2017. Deep value networks learn to evaluate and iteratively refine structured outputs. In International Conference on Machine Learning. 1341\u20131351."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413517"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3214269"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00089"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2021.03.003"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i1.20002"},{"key":"e_1_3_2_27_2","first-page":"1","volume-title":"International Conference on Learning Representations","author":"Kingma Diederik P.","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Lei Ba. 2015. Adam: A method for stochastic optimization. In International Conference on Learning Representations. 1\u201315."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00909"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0075196"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP42928.2021.9506245"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.2986892"},{"key":"e_1_3_2_32_2","first-page":"5103112","article-title":"Semisupervised human activity recognition with radar micro-doppler signatures","volume":"60","author":"Li Xinyu","year":"2021","unstructured":"Xinyu Li, Yuan He, Francesco Fioranelli, and Xiaojun Jing. 2021. Semisupervised human activity recognition with radar micro-doppler signatures. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), 5103112.","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i3.16292"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2018.2793913"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3390\/s20030825"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01022"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968292"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19225043"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18082485"},{"key":"e_1_3_2_40_2","first-page":"8024","volume-title":"Advances in Neural Information Processing Systems","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems. 8024\u20138035."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3191696"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.03.006"},{"key":"e_1_3_2_44_2","first-page":"108","volume-title":"International Symposium on Wearable Computers","author":"Reiss Attila","year":"2012","unstructured":"Attila Reiss and Didier Stricker. 2012. Introducing a new benchmarked dataset for activity monitoring. In International Symposium on Wearable Computers. 108\u2013109."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/PerComWorkshops53856.2022.9767388"},{"key":"e_1_3_2_46_2","first-page":"935","volume-title":"Advances in Neural Information Processing Systems","author":"Socher Richard","year":"2013","unstructured":"Richard Socher, Milind Ganjoo, Christopher D. Manning, and Andrew Y. Ng. 2013. Zero-shot learning through cross-modal transfer. In Advances in Neural Information Processing Systems. 935\u2013943."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00773"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3494995"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00450"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i3.16375"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3264996.3265001"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/SmartWorld.2018.00147"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106426.3106526"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293318"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-47426-3_17"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2857768"},{"key":"e_1_3_2_57_2","first-page":"21969","volume-title":"Advances in Neural Information Processing Systems","author":"Xu Wenjia","year":"2020","unstructured":"Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, and Zeynep Akata. 2020. Attribute prototype network for zero-shot learning. In Advances in Neural Information Processing Systems. 21969\u201321980."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2015.7350760"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0983-5"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.08.027"},{"key":"e_1_3_2_61_2","first-page":"7434","volume-title":"International Conference on Machine Learning","author":"Zhang Fei","year":"2019","unstructured":"Fei Zhang and Guangming Shi. 2019. Co-representation network for generalized zero-shot learning. In International Conference on Machine Learning. 7434\u20137443."},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3103073"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.649"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2020.3039196"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2018.2889315"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582690","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,22]],"date-time":"2023-07-22T08:22:31Z","timestamp":1690014151000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582690"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,5]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,8,31]]}},"alternative-id":["10.1145\/3582690"],"URL":"https:\/\/doi.org\/10.1145\/3582690","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,5]]},"assertion":[{"value":"2022-08-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}
