iBet uBet web content aggregator. Adding the entire web to your favor.
iBet uBet web content aggregator. Adding the entire web to your favor.



Link to original content: https://doi.org/10.1007/s11042-018-5966-9
The impact of drowsiness on in-vehicle human-machine interaction with head-up and head-down displays | Multimedia Tools and Applications Skip to main content
Springer Nature Link
Log in

The impact of drowsiness on in-vehicle human-machine interaction with head-up and head-down displays

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Various studies show that drowsiness reduces driver alertness and can significantly affect driver performance. In this paper, we investigate the effect of drowsiness on the interaction with the in-vehicle infotainment system (IVIS) while driving. The motivation was to investigate whether a specific type of user interface can provide better performance and lower distraction when the driver is drowsy. The users were asked to navigate a vehicle in a driving simulator and simultaneously perform a set of tasks of varying complexity first when they were rested and alert and then when they were drowsy, after 7 h without sleep. A hierarchical, list-based menu was presented using a stereoscopic head-up display (HUD) and a head-down display (HDD). Based on the results, no general and statistically significant connection was found between drowsiness and driving performance. Surprisingly, the secondary task performance was even better when participants were drowsy, which was evident from the faster task completion times. This could be attributed to extra efforts invested in executing tasks as a result of the participants being aware of their drowsiness. However, when comparing the participants’ performance using HUD and HDD displays, the results showed that using HUD introduces less mental fatigue than using HDD but only in rested and alert condition. No significant difference between the displays was found in the drowsy state.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. AblaBmeier M, Poitschke T, Bengler FWK, Rigoll G (2007) Eye gaze studies comparing head-up and head-down displays in vehicles. In: 2007 I.E. International Conference on Multimedia and Expo. IEEE, Beijing, pp 2250–2252

  2. Borghini G, Astolfi L, Vecchiato G, Mattia D, Babiloni F (2014) Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci Biobehav Rev 44:58–75

    Article  Google Scholar 

  3. Boyle LN, Tippin J, Paul A, Rizzo M (2008) Driver performance in the moments surrounding a microsleep. Transport Res F: Traffic Psychol Behav 11(2):126–136

    Article  Google Scholar 

  4. Buck L (1966) Reaction time as a measure of perceptual vigilance. Psychol Bull 65(5):291–304

    Article  Google Scholar 

  5. Cao T, Wan F, Wong CM, da Cruz JN, Hu Y (2014) Objective evaluation of fatigue by EEG spectral analysis in steady-state visual evoked potential-based brain-computer interfaces. Biomed Eng Online 13(1):28

    Article  Google Scholar 

  6. Carskadon MA, Dement WC, Mitler MM, Roth T, Westbrook PR, Keenan S (1986) Guidelines for the multiple sleep latency test (MSLT): a standard measure of sleepiness. Sleep 9(4):519–524

    Article  Google Scholar 

  7. Charissis V, Papanastasiou S (2010) Human–machine collaboration through vehicle head up display interface. Cogn Tech Work 12(1):41–50

    Article  Google Scholar 

  8. Connor J, Norton R, Ameratunga S, Robinson E, Civil I, Dunn R, Bailey J, Jackson R (2002) Driver sleepiness and risk of serious injury to car occupants: population based case control study. BMJ 324(7346):1125

    Article  Google Scholar 

  9. De Waard D, Brookhuis KA (1991) Assessing driver status: a demonstration experiment on the road. Accid Anal Prev 23(4):297–307

    Article  Google Scholar 

  10. Delorme A, Makeig S (2004) EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods 134(1):9–21

    Article  Google Scholar 

  11. Doshi A, Cheng SY, Trivedi MM (2009) A novel active heads-up display for driver assistance. IEEE Trans Syst Man Cybern Part B: Cybern 39(1):85–93

    Article  Google Scholar 

  12. Eoh HJ, Chung MK, Kim SH (2005) Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. Int J Ind Ergon 35(4):307–320

    Article  Google Scholar 

  13. Ferraz M (2000) Warning device for alerting a person falling asleep. Patent and Trademark Office. US Patent 6,087,941, 11 July 2000

  14. Gish KW, Staplin L (1995) Human factors aspects of using head up displays in automobiles: A review of the literature. NHTSA, Interim report (No. Rept No. 1454–02-LR)

  15. Hart SG, Staveland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv Psychol 52:139–183

    Article  Google Scholar 

  16. Horne JA, Reyner LA (1995) Driver sleepiness. J Sleep Res 4(s2):23–29

    Article  Google Scholar 

  17. Ingre M, ÅKerstedt T, Peters B, Anund A, Kecklund G (2006) Subjective sleepiness, simulated driving performance and blink duration: examining individual differences. J Sleep Res 15:47–53

    Article  Google Scholar 

  18. Jakus G, Dicke C, Sodnik J (2015) A user study of auditory, head-up and multi-modal displays in vehicles. Appl Ergon 46:184–192

    Article  Google Scholar 

  19. Johns MW (1991) A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep 14(6):540–545

    Article  Google Scholar 

  20. Kaptein NA (1994) Benefits of in-car head-up displays. TNO-report TNO-TM 1994 B-20. TNO HFRI

  21. Kim H, Wu X, Gabbard JL, Polys NF (2013) Exploring head-up augmented reality interfaces for crash warning systems. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, pp. 224–227

  22. Lal SK, Craig A (2001) A critical review of the psychophysiology of driver fatigue. Biol Psychol 55(3):173–194

    Article  Google Scholar 

  23. Liu YC, Wen MH (2004) Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan. Int J Hum Comput Stud 61(5):679–697

    Article  MathSciNet  Google Scholar 

  24. Liu YC, Wu TJ (2009) Fatigued driver’s driving behavior and cognitive task performance: effects of road environments and road environment changes. Saf Sci 47(8):1083–1089

    Article  Google Scholar 

  25. Lyznicki JM, Doege TC, Davis RM, Williams MA (1998) Sleepiness, driving, and motor vehicle crashes. Jama 279(23):1908–1913

    Article  Google Scholar 

  26. National Center for Statistics and Analysis (2011) Traffic safety fact crash stats: drowsy driving. (DOT HS 811 449). Washington, DC: National Highway Traffic Safety Administration. Retrieved from http://www-nrd.nhtsa.dot.gov/pubs/811449.pdf

  27. Nordbakke S, Sagberg F (2007) Sleepy at the wheel: knowledge, symptoms and behaviour among car drivers. Transport Res F: Traffic Psychol Behav 10(1):1–10

    Article  Google Scholar 

  28. Otmani S, Pebayle T, Roge J, Muzet A (2005) Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers. Physiol Behav 84:715–724

    Article  Google Scholar 

  29. Park HS, Park MW, Won KH, Kim KH, Jung SK (2013) In-vehicle AR-HUD system to provide driving-safety information. ETRI J 35(6):1038–1047

    Article  Google Scholar 

  30. Poitschke T, Ablaßmeier M, Rigoll G, Bardins S, Kohlbecher S, Schneider E (2008) Contact-analog information representation in an automotive head-up display. In Proceedings of the 2008 symposium on Eye tracking research & applications. ACM, pp. 119–122

  31. Rimini-Doering M, Altmueller T, Ladstaetter U, Rossmeier M 2005 Effects of lane departure warning on drowsy drivers’ performance and state in a simulator. In Proceedings of the Third International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, pp. 88–95

  32. Risser MR, Ware JC (1999) Driving simulation with EEG monitoring in normals and obstructive sleep apnea patients. Annu Proc Assoc Adv Automot Med 43: 317–328

    Google Scholar 

  33. Shahid A, Wilkinson K, Marcu S, Shapiro CM (2011) Karolinska sleepiness scale (KSS). In: STOP, THAT and one hundred other sleep scales. Springer, New York, pp 209–210

    Chapter  Google Scholar 

  34. Summala H, Hakkanen H, Mikkola T, Sinkkonen J (1999) Task effects on fatigue symptoms in overnight driving. Ergonomics 42(6):798–806

    Article  Google Scholar 

  35. Tefft BC (2014) Prevalence of motor vehicle crashes involving drowsy drivers, United States, 2009–2013. AAA Foundation for Traffic Safety, Washington, DC

    Google Scholar 

  36. Thiffault P, Bergeron J (2003) Monotony of road environment and driver fatigue: a simulator study. Accid Anal Prev 35:381–391

    Article  Google Scholar 

  37. Tran, C., Bark, K. and Ng-Thow-Hing, V., 2013. A left-turn driving aid using projected oncoming vehicle paths with augmented reality. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, pp. 300–307

  38. Van den Berg J, Landström U (2006) Symptoms of sleepiness while driving and their relationship to prior sleep, work and individual characteristics. Transport Res F: Traffic Psychol Behav 9(3):207–226

    Article  Google Scholar 

  39. Vural E, Cetin M, Ercil A, Littlewort G, Bartlett M, Movellan J (2007) Drowsy driver detection through facial movement analysis. In International Workshop on Human-Computer Interaction. Springer, Berlin, Heidelberg, pp. 6–18

  40. Warwick, B., Symons, N., Chen, X., Xiong, K. (2015). Detecting driver drowsiness using wireless wearables. In Mobile Ad Hoc and Sensor Systems (MASS), 2015 I.E. 12th International Conference on. IEEE, pp. 585–588

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and Computer Science, University of Liège, Quartier Polytech 1, Allée de la découverte 10, 4000, Liège, Belgium

    David Grogna & Jacques G. Verly

  2. Faculty of Electrical Engineering, University of Ljubljana, Tržaška cesta 25, 1000, Ljubljana, Slovenia

    Kristina Stojmenova, Grega Jakus & Jaka Sodnik

  3. Eurecat – Technology Centre of Catalonia, Av. Diagonal 177, planta 9, 08018, Barcelona, Spain

    Miguel Barreda- Ángeles

Authors
  1. David Grogna
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kristina Stojmenova
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Grega Jakus
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Miguel Barreda- Ángeles
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jacques G. Verly
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jaka Sodnik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Grogna.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grogna, D., Stojmenova, K., Jakus, G. et al. The impact of drowsiness on in-vehicle human-machine interaction with head-up and head-down displays. Multimed Tools Appl 77, 27807–27827 (2018). https://doi.org/10.1007/s11042-018-5966-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5966-9

Keywords

Search

Navigation