Abstract
In this work, an augmented reality (AR) system is proposed to monitor in real time the patient’s vital parameters during surgical procedures. This system is characterised metrologically in terms of transmission error rates and latency. These specifications are relevant for ensuring real-time response. The proposed system automatically collects data from the equipment in the operating room (OR), and displays them in AR. The system was designed, implemented and validated through experimental tests carried out using a set of Epson Moverio BT-350 AR glasses to monitor the output of a respiratory ventilator and a patient monitor in the OR.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alesanco, A., García, J.: Clinical assessment of wireless ECG transmission in real-time cardiac telemonitoring. IEEE Trans. Inf Technol. Biomed. 14(5), 1144–1152 (2010)
Alharthi, A.S., Yunas, S.U., Ozanyan, K.B.: Deep learning for monitoring of human gait: a review. IEEE Sens. J. 19(21), 9575–9591 (2019). https://doi.org/10.1109/JSEN.2019.2928777
Alotaibi, B.: Utilizing blockchain to overcome cyber security concerns in the internet of things: a review. IEEE Sens. J. 19(23), 10953–10971 (2019)
Angrisani, L., Grazioso, S., Di Gironimo, G., Panariello, D., Tedesco, A.: On the use of soft continuum robots for remote measurement tasks in constrained environments: a brief overview of applications. In: 2019 IEEE International Symposium on Measurements and Networking, M&N 2019 (2019). https://doi.org/10.1109/IWMN.2019.8805050
Angrisani, L., Arpaia, P., Esposito, A., Moccaldi, N.: A wearable brain-computer interface instrument for augmented reality-based inspection in industry 4.0. IEEE Trans. Instrum. Meas. 69, 1530–1539 (2019)
Arpaia, P., Dallet, D., Erra, E., Tedesco, A.: Reliability measurements of an augmented reality-based 4.0 system for supporting workmen in handmade assembly. In: 24th IMEKO TC4 International Symposium and 22nd International Workshop on ADC and DAC Modelling and Testing, pp. 190–195 (2020)
Arpaia, P., De Benedetto, E., Duraccio, L.: Design, implementation, and metrological characterization of a wearable, integrated AR-BCI hands-free system for health 4.0 monitoring. Measurement 177, 109280 (2021). https://doi.org/10.1016/j.measurement.2021.109280
Arpaia, P., De Benedetto, E., Dodaro, C.A., Duraccio, L., Servillo, G.: Metrology-based design of a wearable augmented reality system for monitoring patient’s vitals in real time. IEEE Sens. J. 21(9), 11176–11183 (2021). https://doi.org/10.1109/JSEN.2021.3059636
Bernasconi, R., Meroni, D., Aliverti, A., Magagnin, L.: Fabrication of a bioimpedance sensor via inkjet printing and selective metallization. IEEE Sens. J. 20(23), 14024–14031 (2020)
Bloomfield, R.A., Teeter, M.G., McIsaac, K.A.: A convolutional neural network approach to classifying activities using knee instrumented wearable sensors. IEEE Sens. J. 20, 14975–14983 (2020)
Cepisca, C., Adochiei, F.C., Potlog, S., Banica, C.K., Seritan, G.C.: Platform for bio-monitoring of vital parameters in critical infrastructures operation. In: 2015 7th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), pp. E-7. IEEE (2015)
Chang, J.Y.C., Tsui, L.Y., Yeung, K.S.K., Yip, S.W.Y., Leung, G.K.K.: Surgical vision: Google glass and surgery. Surg. Innov. 23(4), 422–426 (2016)
Condino, S., et al.: Hybrid simulation and planning platform for cryosurgery with Microsoft Hololens. Sensors 21(13) (2021). https://doi.org/10.3390/s21134450
Corchia, L., et al.: Fully-textile, wearable chipless tags for identification and tracking applications. Sensors 20(2) (2020). https://doi.org/10.3390/s20020429
Corchia, L., Monti, G., De Benedetto, E., Tarricone, L.: Low-cost chipless sensor tags for wearable user interfaces. IEEE Sens. J. 19(21), 10046–10053 (2019). https://doi.org/10.1109/JSEN.2019.2927823
Cutolo, F., Fida, B., Cattari, N., Ferrari, V.: Software framework for customized augmented reality headsets in medicine. IEEE Access 8, 706–720 (2020). https://doi.org/10.1109/ACCESS.2019.2962122
Grazioso, S., Tedesco, A., Selvaggio, M., Debei, S., Chiodini, S.: Towards the development of a cyber-physical measurement system (CPMS): case study of a bioinspired soft growing robot for remote measurement and monitoring applications. ACTA IMEKO 10(2), 103–109 (2021). http://dx.doi.org/10.21014/acta_imeko.v10i2.1123
Grazioso, S., et al.: Design of a soft growing robot as a practical example of cyber-physical measurement systems. In: IEEE Metrology for Industry 4.0 and IoT Proceedings. IEEE (2021). https://doi.org/10.1109/MetroInd4.0IoT51437.2021.9488477
He, C., Liu, Y., Wang, Y.: Sensor-fusion based augmented-reality surgical navigation system. In: 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings, pp. 1–5 (May 2016)
McDuff, D., Hurter, C., Gonzalez-Franco, M.: Pulse and vital sign measurement in mixed reality using a Hololens. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, pp. 1–9 (2017)
Meyer, J., Schlebusch, T., Fuhl, W., Kasneci, E.: A novel camera-free eye tracking sensor for augmented reality based on laser scanning. IEEE Sens. J. 20, 15204–15212 (2020)
Muhammed, T., Mehmood, R., Albeshri, A., Katib, I.: UbeHealth: a personalized ubiquitous cloud and edge-enabled networked healthcare system for smart cities. IEEE Access 6, 32258–32285 (2018)
Ormerod, D., Ross, B., Naluai-Cecchini, A.: Use of an augmented reality display of patient monitoring data to enhance anesthesiologists’ response to abnormal clinical events. Stud. Health Technol. Inform. 94, 248–250 (2003). https://doi.org/10.3233/978-1-60750-938-7-248
Pace, P., Aloi, G., Gravina, R., Caliciuri, G., Fortino, G., Liotta, A.: An edge-based architecture to support efficient applications for healthcare industry 4.0. IEEE Trans. Ind. Inform. 15(1), 481–489 (2019)
Rauschnabel, P.A., Ro, Y.K.: Augmented reality smart glasses: an investigation of technology acceptance drivers. Int. J. Technol. Mark. 11(2), 123–148 (2016)
Sanderson, P.M., et al.: Advanced auditory displays and head-mounted displays: advantages and disadvantages for monitoring by the distracted anesthesiologist. Anesth. Analg. 106(6), 1787–1797 (2008)
Schiavoni, R., et al.: Feasibility of a wearable reflectometric system for sensing skin hydration. Sensors 20(10), 2833 (2020). https://doi.org/10.3390/s20102833
Spanò, E., Di Pascoli, S., Iannaccone, G.: Low-power wearable ECG monitoring system for multiple-patient remote monitoring. IEEE Sens. J. 16(13), 5452–5462 (2016)
Teague, C.N., et al.: A wearable, multimodal sensing system to monitor knee joint health. IEEE Sens. J. 20(18), 10323–10334 (2020). https://doi.org/10.1109/JSEN.2020.2994552
Viglialoro, R., Condino, S., Turini, G., Carbone, M., Ferrari, V., Gesi, M.: Augmented reality, mixed reality, and hybrid approach in healthcare simulation: a systematic review. Appl. Sci. (Switz.) 11(5), 1–20 (2021). https://doi.org/10.3390/app11052338
Wannenburg, J., Malekian, R., Hancke, G.P.: Wireless capacitive-based ECG sensing for feature extraction and mobile health monitoring. IEEE Sens. J. 18(14), 6023–6032 (2018)
Wehde, M.: Healthcare 4.0. IEEE Eng. Manage. Rev. 47(3), 24–28 (2019). https://doi.org/10.1109/EMR.2019.2930702
Zhang, B., Hong, X., Liu, Y.: Multi-task deep transfer learning method for guided wave-based integrated health monitoring using piezoelectric transducers. IEEE Sens. J. 20(23), 14391–14400 (2020)
Acknowledgment
This work was carried out as part of the “ICT for Health” project, which was financially supported by the Italian Ministry of Education, University and Research (MIUR), under the initiative ‘Departments of Excellence’ (Italian Law no. 232/2016), through an excellence grant awarded to the Department of Information Technology and Electrical Engineering of the University of Naples Federico II, Naples, Italy.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Arpaia, P., Crauso, F., De Benedetto, E., Duraccio, L., Improta, G. (2021). An Augmented Reality-Based Solution for Monitoring Patients Vitals in Surgical Procedures. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-87595-4_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87594-7
Online ISBN: 978-3-030-87595-4
eBook Packages: Computer ScienceComputer Science (R0)