http://iet.metastore.ingenta.com
1887

Lateral distance detection model based on convolutional neural network

Lateral distance detection model based on convolutional neural network

For access to this article, please select a purchase option:

Buy eFirst article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
— Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

To evaluate the performance of the advanced driver assistant systems, such as lane departure warning systems (LDWs) and lane keeping assist systems (LKAs), a deep learning model is proposed to estimate the lateral distance between the vehicle and lane boundaries. The training of a deep learning model requires a large number of label images, but the generation of label images is time consuming and boring. Therefore, an improved image quilting algorithm based on a convolutional neural network is proposed. A lot of lane and asphalt pavement images can be synthesised using fewer images of a real road scene. Moreover, an algorithm that aims to automatically generate label images using lane and asphalt pavement images to satisfy the distribution of real scenes is proposed. Experimental results showed that the generated label images can be used to train a deep learning model, and the lateral distance can be estimated with a sub-centimetre precision, which can provide an effective benchmark for the road test of LDWs, LKAs and other driving assistant systems.

References

    1. 1)
      • Y. Huang , H. Wang , A. Khajepour .
        1. Huang, Y., Wang, H., Khajepour, A., et al: ‘Model predictive control power management strategies for HEVs: a review’, J. Power Sources, 2017, 341, pp. 91106.
        . J. Power Sources , 91 - 106
    2. 2)
      • Y. Huang , A. Khajepour , H. Ding .
        2. Huang, Y., Khajepour, A., Ding, H., et al: ‘An energy-saving set-point optimizer with a sliding mode controller for automotive air-conditioning/refrigeration systems’, Appl. Energy, 2017, 188, pp. 576585.
        . Appl. Energy , 576 - 585
    3. 3)
      • X. Tang , W. Yang , X. Hu .
        3. Tang, X., Yang, W., Hu, X., et al: ‘A novel simplified model for torsional vibration analysis of a series-parallel hybrid electric vehicle’, Mech. Syst. Signal Process., 2017, 85, pp. 329338.
        . Mech. Syst. Signal Process. , 329 - 338
    4. 4)
      • J. Wang , M. Dai , G. Yin .
        4. Wang, J., Dai, M., Yin, G., et al: ‘Output-feedback robust control for vehicle path tracking considering different human drivers’ characteristics’, Mechatronics, 2017, doi: 10.1016/j.mechatronics.2017.05.001.
        . Mechatronics
    5. 5)
      • Y. Qin , C. He , X. Shao .
        5. Qin, Y., He, C., Shao, X., et al: ‘Vibration mitigation for in-wheel switched reluctance motor driven electric vehicle with dynamic vibration absorbing structures’, J. Sound Vib., 2018, 419, pp. 249267.
        . J. Sound Vib. , 249 - 267
    6. 6)
      • H. Wang , Y. Huang , A. Khajepour .
        6. Wang, H., Huang, Y., Khajepour, A., et al: ‘A novel energy management for hybrid off-road vehicles without future driving cycles as a priori’, Energy, 2017, 133, pp. 929940.
        . Energy , 929 - 940
    7. 7)
      • C. Zou , X. Hu , Z. Wei .
        7. Zou, C., Hu, X., Wei, Z., et al: ‘Electrothermal dynamics-conscious lithium-ion battery cell-level charging management via state-monitored predictive control’, Energy, 2017, 141, pp. 250259.
        . Energy , 250 - 259
    8. 8)
      • X. Tang , X. Hu , W. Yang .
        8. Tang, X., Hu, X., Yang, W., et al: ‘Novel torsional vibration modeling and assessment of a power-split hybrid electric vehicle equipped with a dual mass flywheel’, IEEE Trans. Veh. Technol., 2017, 67, pp. 19902000, doi:10.1109/TVT.2017.2769084.
        . IEEE Trans. Veh. Technol. , 1990 - 2000
    9. 9)
      • H. Lee , S. Jeong , J. Lee .
        9. Lee, H., Jeong, S., Lee, J.: ‘Robust detection system of illegal lane changes based on tracking of feature points’, IET Intell. Transp. Syst., 2013, 7, (1), pp. 2027.
        . IET Intell. Transp. Syst. , 1 , 20 - 27
    10. 10)
      • P. Lorenz , B. Schäufele , O. Sawade .
        10. Lorenz, P., Schäufele, B., Sawade, O., et al: ‘Recursive state estimation for lane detection using a fusion of cooperative and map based data’. IEEE 18th Int. Conf. on Intelligent Transportation Systems, Las Palmas de Gran Canaria Canary Islands, Spain, 2015, pp. 21802185.
        . IEEE 18th Int. Conf. on Intelligent Transportation Systems , 2180 - 2185
    11. 11)
      • A. Borkar , M. Hayes , M.T. Smith .
        11. Borkar, A., Hayes, M., Smith, M.T.: ‘A novel lane detection system with efficient ground truth generation’, IEEE Trans. Intell. Transp. Syst., 2012, 13, (1), pp. 365374.
        . IEEE Trans. Intell. Transp. Syst. , 1 , 365 - 374
    12. 12)
      • A. Al-Sarraf , B.S. Shin , Z. Xu .
        12. Al-Sarraf, A., Shin, B.S., Xu, Z., et al: ‘Ground truth and performance evaluation of lane border detection’. Int. Conf. on Computer Vision and Graphics, Warsaw, Poland, September 2014, pp. 6674.
        . Int. Conf. on Computer Vision and Graphics , 66 - 74
    13. 13)
      • A.Y. Hata , D.F. Wolf .
        13. Hata, A.Y., Wolf, D.F.: ‘Feature detection for vehicle localization in urban environments using a multilayer LIDAR’, IEEE Trans. Intell. Transp. Syst., 2016, 17, (2), pp. 420429.
        . IEEE Trans. Intell. Transp. Syst. , 2 , 420 - 429
    14. 14)
      • D. Ma , X. Luo , W. Li .
        14. Ma, D., Luo, X., Li, W., et al: ‘Traffic demand estimation for lane groups at signal-controlled intersections using travel times from video-imaging detectors’, IET Intell. Transp. Syst., 2017, 11, (4), pp. 222229.
        . IET Intell. Transp. Syst. , 4 , 222 - 229
    15. 15)
      • J. Baili , M. Marzougui , A. Sboui .
        15. Baili, J., Marzougui, M., Sboui, A., et al: ‘Lane Departure detection using image processing techniques’. 2017 2nd IEEE Int. Conf. on Anti-Cyber Crimes (ICACC, 2017), Abha, Saudi Arabia, March 2017, pp. 238241.
        . 2017 2nd IEEE Int. Conf. on Anti-Cyber Crimes (ICACC, 2017) , 238 - 241
    16. 16)
      • S.J. Mankar , M. Demde , P. Sharma .
        16. Mankar, S.J., Demde, M., Sharma, P.:Design of computer vision intelligent system for lane detection’. IEEE Int. Conf. on Green Engineering and Technologies (IC-GET), Coimbatore, India, November 2016, pp. 13.
        . IEEE Int. Conf. on Green Engineering and Technologies (IC-GET) , 1 - 3
    17. 17)
      • I. El Hajjouji , A. El Mourabit , Z. Asrih .
        17. El Hajjouji, I., El Mourabit, A., Asrih, Z., et al: ‘FPGA based real-time lane detection and tracking implementation’. 2016 IEEE Int. Conf. on Electrical and Information Technologies (ICEIT, 2016), Tangiers, Morocco, May 2016, pp. 186190.
        . 2016 IEEE Int. Conf. on Electrical and Information Technologies (ICEIT, 2016) , 186 - 190
    18. 18)
      • D. Gruyer , R. Belaroussi , M. Revilloud .
        18. Gruyer, D., Belaroussi, R., Revilloud, M.: ‘Accurate lateral positioning from map data and road marking detection’, Expert Syst. Appl., 2016, 43, pp. 18.
        . Expert Syst. Appl. , 1 - 8
    19. 19)
      • J. Li , X. Mei , D. Prokhorov .
        19. Li, J., Mei, X., Prokhorov, D., et al: ‘Deep neural network for structural prediction and lane detection in traffic scene’, IEEE Trans. Neural Netw. Learn. Syst., 2017, 28, (3), pp. 690703.
        . IEEE Trans. Neural Netw. Learn. Syst. , 3 , 690 - 703
    20. 20)
      • C.A. Brust , S. Sickert , M. Simon .
        20. Brust, C.A., Sickert, S., Simon, M., et al: ‘Convolutional patch networks with spatial prior for road detection and urban scene understanding’, arXiv preprint arXiv:1502.06344, 2015.
        .
    21. 21)
      • J. Kim , M. Lee .
        21. Kim, J., Lee, M.:Robust lane detection based on convolutional neural network and random sample consensus’. Int. Conf. on Neural Information Processing, Sarawak, Malaysia, November 2014, pp. 454461.
        . Int. Conf. on Neural Information Processing , 454 - 461
    22. 22)
      • Y. Qin , R. Langari , Z. Wang .
        22. Qin, Y., Langari, R., Wang, Z., et al: ‘Road excitation classification for semi-active suspension system with deep neural networks’, J. Intell. Fuzzy Syst., 2017, 33, (3), pp. 19071918.
        . J. Intell. Fuzzy Syst. , 3 , 1907 - 1918
    23. 23)
      • M. Revilloud , D. Gruyer , M.C. Rahal .
        23. Revilloud, M., Gruyer, D., Rahal, M.C.: ‘A new multi-agent approach for lane detection and tracking’. IEEE Int. Conf. on Robotics and Automation (ICRA), Stockholm, Sweden, May 2016, pp. 31473153.
        . IEEE Int. Conf. on Robotics and Automation (ICRA) , 3147 - 3153
    24. 24)
      • A. Gurghian , T. Koduri , S.V. Bailur .
        24. Gurghian, A., Koduri, T., Bailur, S.V., et al:DeepLanes: end-to-end lane position estimation using deep neural networks’. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Nevada, July 2016, pp. 3845.
        . IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) , 38 - 45
    25. 25)
      • R. Marc , G. Dominique , P. Evangeline .
        25. Marc, R., Dominique, G., Evangeline, P.: ‘Generator of road marking textures and associated ground truth applied to the evaluation of road marking detection’. 2012 15th Int. IEEE Conf. on Intelligent Transportation Systems, Anchorage, AK, USA, 2012, pp. 933938.
        . 2012 15th Int. IEEE Conf. on Intelligent Transportation Systems , 933 - 938
    26. 26)
      • E. Santana , G. Hotz .
        26. Santana, E., Hotz, G.: ‘Learning a driving simulator’, arXiv preprint arXiv:1608.01230, 2016.
        .
    27. 27)
      • A.A. Efros , W.T. Freeman .
        27. Efros, A.A., Freeman, W.T.: ‘Image quilting for texture synthesis and transfer’. 28th Annual Conf. on Computer Graphics and Interactive Techniques, ACM, Los Angeles, CA, USA, August 2001, pp. 341346.
        . 28th Annual Conf. on Computer Graphics and Interactive Techniques, ACM , 341 - 346
    28. 28)
      • B. Galerne , Y. Gousseau , J.M. Morel .
        28. Galerne, B., Gousseau, Y., Morel, J.M.: ‘Random phase textures: theory and synthesis’, IEEE Trans. Image Process., 2011, 20, (1), pp. 257267.
        . IEEE Trans. Image Process. , 1 , 257 - 267
    29. 29)
      • J. Long , D. Mould .
        29. Long, J., Mould, D.: ‘Improved image quilting’. Graphics Interface ACM, Montreal, Canada, 2007, pp. 257264.
        . Graphics Interface ACM , 257 - 264
    30. 30)
      • Q.N. Van , M. Yoon , W. Che .
        30. Van, Q.N., Yoon, M., Che, W., et al: ‘A study on real time integrated lane detection and vehicle tracking method with side-mirror cameras’. IEEE 14th Int. Workshop on Advanced Motion Control (AMC), Auckland, New Zealand, April 2016, pp. 346352.
        . IEEE 14th Int. Workshop on Advanced Motion Control (AMC) , 346 - 352
    31. 31)
      • E. Shelhamer , J. Long , T. Darrell .
        31. Shelhamer, E., Long, J., Darrell, T.: ‘Fully convolutional networks for semantic segmentation’, IEEE Trans. Pattern Anal. Mach. Intell., 2017, 39, (4), pp. 640651.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 4 , 640 - 651
    32. 32)
      • H.C. Shin , H.R. Roth , M. Gao .
        32. Shin, H.C., Roth, H.R., Gao, M., et al: ‘Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning’, IEEE Trans. Med. Imaging, 2016, 35, (5), pp. 12851298..
        . IEEE Trans. Med. Imaging , 5 , 1285 - 1298
    33. 33)
      • A. Krizhevsky , I. Sutskever , G.E. Hinton .
        33. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ‘ImageNet classification with deep convolutional neural networks’. Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, 2012, pp. 10971105.
        . Advances in Neural Information Processing Systems , 1097 - 1105
    34. 34)
      • A. Babenko , A. Slesarev , A. Chigorin .
        34. Babenko, A., Slesarev, A., Chigorin, A., et al: ‘Neural codes for image retrieval’. European Conf. on Computer Vision, Zurich, Switzerland, September 2014, pp. 584599.
        . European Conf. on Computer Vision , 584 - 599
    35. 35)
      • D. Backenroth , J. Goldsmith , M.D. Harran .
        35. Backenroth, D., Goldsmith, J., Harran, M.D., et al: ‘Modeling motor learning using heteroskedastic functional principal components analysis’, J. Am. Stat. Assoc., 2017, doi: 10.1080/01621459.2017.1379403.
        . J. Am. Stat. Assoc.
    36. 36)
      • L. Raad , B. Galerne .
        36. Raad, L., Galerne, B.: ‘Efros and Freeman image quilting algorithm for texture synthesis’, Image Process. On Line, 2017, 7, pp. 122.
        . Image Process. On Line , 1 - 22
    37. 37)
      • K.W. Chung , H.S.Y. Chan , B.N. Wang .
        37. Chung, K.W., Chan, H.S.Y., Wang, B.N.: ‘Automatic generation of nonperiodic patterns from dynamical systems’, Chaos, Solitons Fract., 2004, 19, (5), pp. 11771187.
        . Chaos, Solitons Fract. , 5 , 1177 - 1187
    38. 38)
      • J.M. Alvarez , A. Lopez , R. Baldrich .
        38. Alvarez, J.M., Lopez, A., Baldrich, R.: ‘Illuminant-invariant model-based road segmentation’. IEEE Intelligent Vehicles Symp., Netherlands, June 2008, pp. 11751180.
        . IEEE Intelligent Vehicles Symp. , 1175 - 1180
    39. 39)
      • K. Lin , H.F. Yang , J.H. Hsiao .
        39. Lin, K., Yang, H.F., Hsiao, J.H., et al: ‘Deep learning of binary hash codes for fast image retrieval’. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Boston, Massachusetts, June 2015, pp. 2735.
        . IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) , 27 - 35
    40. 40)
      • S. Zheng , S. Jayasumana , B. Romera-Paredes .
        40. Zheng, S., Jayasumana, S., Romera-Paredes, B., et al: ‘Conditional random fields as recurrent neural networks’. IEEE Int. Conf. on Computer Vision (ICCV), Chile, December 2015, pp. 15291537.
        . IEEE Int. Conf. on Computer Vision (ICCV) , 1529 - 1537
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-its.2017.0431
Loading

Related content

content/journals/10.1049/iet-its.2017.0431
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address