Abstract
Localization of the vehicle with respect to road lanes plays a critical role in the advances of making the vehicle fully autonomous. Vision based road lane line detection provides a feasible and low cost solution as the vehicle pose can be derived from the detection. While good progress has been made, the road lane line detection has remained an open one, given challenging road appearances with shadows, varying lighting conditions, worn-out lane lines etc. In this paper, we propose a more robust vision-based approach with respect to these challenges. The approach incorporates four key steps. Lane line pixels are first pooled with a ridge detector. An effective noise filtering mechanism will next remove noise pixels to a large extent. A modified version of sequential RANdom Sample Consensus) is then adopted in a model fitting procedure to ensure each lane line in the image is captured correctly. Finally, if lane lines on both sides of the road exist, a parallelism reinforcement technique is imposed to improve the model accuracy. The results obtained show that the proposed approach is able to detect the lane lines accurately and at a high success rate compared to current approaches. The model derived from the lane line detection is capable of generating precise and consistent vehicle localization information with respect to road lane lines, including road geometry, vehicle position and orientation.
Similar content being viewed by others
References
Aufrere, R., Chapuis, R., Chausse, F.: A model-driven approach for real-time road recognition. Mach. Vis. Appl. 13(2), 95–107 (2001)
Borkar, A., Hayes, M., Smith, M.T.: A novel lane detection system with efficient ground truth generation. Intell. Transp. Syst. IEEE Trans. 13(1), 365–374 (2012)
Bouguet, J.Y.: Camera calibration toolbox for matlab. (2010-07). http://www.vision.caltech.edu/bouguetj/calib_doc/
Danescu, R., Nedevschi, S.: Probabilistic lane tracking in difficult road scenarios using stereovision. Intell. Transp. Syst. IEEE Trans. 10(2), 272–282 (2009)
David, F., Scharstein, D.: Multi-model estimation in the presence of outliers. Master’s thesis, Middlebury College (2011)
Fritsch, J., Kuhnl, T., Kummert, F.: Monocular road terrain detection by combining visual and spatial information. Intell. Transp. Syst. IEEE Trans. 15(4), 1586–1596 (2014)
Gopalan, R., Hong, T., Shneier, M., Chellappa, R.: A learning approach towards detection and tracking of lane markings. Intell. Transp. Syst. IEEE Trans. 13(3), 1088–1098 (2012)
Guiducci, A.: Parametric model of the perspective projection of a road with applications to lane keeping and 3d road reconstruction. Comput. Vis. Image Underst. 73(3), 414–427 (1999)
Gyory, G.: Obstacle detection methods for stereo vision as driving aid. In: Advanced Robotics, 2003. International Conference on, IEEE, pp. 477–481 (2003)
Hillel, A.B., Lerner, R., Levi, D., Raz, G.: Recent progress in road and lane detection: a survey. Mach. Vis. Appl. 25(3), 727–745 (2014)
Kang, D.J., Jung, M.H.: Road lane segmentation using dynamic programming for active safety vehicles. Pattern Recogn. Lett. 24(16), 3177–3185 (2003)
Kim, Z.: Robust lane detection and tracking in challenging scenarios. Intell. Transp. Syst. IEEE Trans. 9(1), 16–26 (2008)
Li, H., Nashashibi, F.: Robust real-time lane detection based on lane mark segment features and general a priori knowledge. In: Robotics and Biomimetics (ROBIO), 2011 IEEE International Conference on, IEEE, pp. 812–817 (2011)
Li, Q., Zheng, N., Cheng, H.: An adaptive approach to lane markings detection. In: Intelligent transportation systems, 2003. Proceedings., IEEE, vol. 1, pp. 510–514 (2003)
Liu, W., Zhang, H., Duan, B., Yuan, H., Zhao, H.: Vision-based real-time lane marking detection and tracking. In: Intelligent transportation systems, 2008. ITSC 2008. 11th International IEEE Conference on, IEEE, pp. 49–54 (2008)
López, A., Serrat, J., Canero, C., Lumbreras, F., Graf, T.: Robust lane markings detection and road geometry computation. Int. J. Autom. Technol. 11(3), 395–407 (2010)
McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. Intell. Transp. Syst. IEEE Trans. 7(1), 20–37 (2006)
Nedevschi, S., Schmidt, R., Graf, T., Danescu, R., Frentiu, D., Marita, T., Oniga, F., Pocol, C.: 3d lane detection system based on stereovision. In: Intelligent transportation systems, 2004. Proceedings. The 7th International IEEE Conference on, IEEE, pp. 161–166 (2004)
Press, W.H.: Numerical recipes in Fortran 77: the art of scientific computing, vol. 1. Cambridge University Press (1992)
Sampson, P.D.: Fitting conic sections to very scattered data: an iterative refinement of the bookstein algorithm. Comput. Graph. Image Process. 18(1), 97–108 (1982)
Sivaraman, S., Trivedi, M.M.: Integrated lane and vehicle detection, localization, and tracking: a synergistic approach. Intell. Transp. Syst. IEEE Trans. 14(2), 906–917 (2013)
Sun, T.Y., Tsai, S.J., Chan, V.: Hsi color model based lane-marking detection. In: Intelligent transportation systems conference, ITSC’06. IEEE, pp. 1168–1172 (2006)
Tapia-Espinoza, R., Torres-Torriti, M.: A comparison of gradient versus color and texture analysis for lane detection and tracking. In: Robotics symposium (LARS), 2009 6th Latin American, IEEE, pp. 1–6 (2009)
Thorpe, C., Hebert, M.H., Kanade, T., Shafer, S.A.: Vision and navigation for the carnegie-mellon navlab. Pattern Anal. Mach. Intell. IEEE Trans. 10(3), 362–373 (1988)
Wang, J., Schroedl, S., Mezger, K., Ortloff, R., Joos, A., Passegger, T.: Lane keeping based on location technology. Intell. Transp. Syst. IEEE Trans. 6(3), 351–356 (2005)
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material 1 (mp4 5717 KB)
Supplementary material 2 (mp4 5705 KB)
Rights and permissions
About this article
Cite this article
Du, X., Tan, K.K. Vision-based approach towards lane line detection and vehicle localization. Machine Vision and Applications 27, 175–191 (2016). https://doi.org/10.1007/s00138-015-0735-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-015-0735-5