3D vehicle detection using a laser scanner and a video camera

3D vehicle detection using a laser scanner and a video camera

For access to this article, please select a purchase option:

Buy article PDF
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
IET Intelligent Transport Systems — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

A new approach for vehicle detection performs sensor fusion of a laser scanner and a video sensor. This combination provides enough information to handle the problem of multiple views of a car. The laser scanner estimates the distance as well as the contour information of observed objects. The contour information can be used to identify the discrete sides of rectangular objects in the laser scanner coordinate system. The transformation of the three-dimensional coordinates of the most visible side to the image coordinate system allows for a reconstruction of its original view. This transformation also compensates size differences in the video image, which are caused by different distances to the video sensor. Afterwards, a pattern recognition algorithm can classify the object's sides based on contour and shape information. Since the number of available object hypotheses is enormously reduced by the laser scanner, the system is applicable in real time. In addition, video-based vehicle detection and additional laser scanner features are fused in order to create a consistent vehicle environment description.


    1. 1)
      • Ponza, D., Lopez, A., Lumbreras, F., Serrat, J., Graf, T.: `3D vehicle sensor based on monocular vision', Proc. IEEE Conf. Intelligent Transportation Systems, 2005, Vienna, Austria.
    2. 2)
      • Khammari, A., Nashashibi, F., Abramson, Y., Laurgeau, C.: `Vehicle detection combining gradient analysis and AdaBoost classification', Proc. IEEE 8th Int. Conf. Intelligent Transport Systems, 2005, Vienna, Austria.
    3. 3)
      • Kaempchen, N., Dietmayer, K.: `Fusion of Laserscanner and video for advanced driver assistance systems', Proc. 11th World Congress on Intelligent Transportation Systems, 2004, Nagoya, Japan.
    4. 4)
      • Maehlisch, M., Schweiger, R., Ritter, W., Dietmayer, K.: `Sensorfusion using spatio-temporal aligned video and lidar for improved vehicle detection', Proc. Intelligent Vehicles Symposium 2006, 2006, Tokyo, Japan.
    5. 5)
      • Kaempchen, N.: `Feature-level fusion of laser scanner and video data for advanced driver assistance systems', 2007, PhD, Ulm University.
    6. 6)
      • Takizawa, H., Yamada, K., Ito, T.: `Vehicles detection using sensor fusion', Proc. 2004 IEEE Intelligent Vehicles Symposium, 2004, Parma, Italy.
    7. 7)
      • Schneiderman, H., Kanade, T.: `A statistical model for 3D object detection applied to faces and cars', Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
    8. 8)
      • O. Faugeras . (1993) Three-dimensional computer vision.
    9. 9)
      • Wender, S., Fuerstenberg, K.Ch., Dietmayer, K.C.J.: `Object tracking and classification for intersection scenarios using a multilayer laser scanner', Proc. 11th World Congress on Intelligent Transportation Systems, 2004, Nagoya, Japan.
    10. 10)
      • Intel Research Labs: ‘Open Source Computer Vision Library’, Online available at:, accessed October 2007.
    11. 11)
      • P. Viola , M. Jones . (2002) Fast and robust classification using asymmetric AdaBoost and a detector cascade, Advances in Neural Information Processing Systems 14.
    12. 12)
      • Lindner, F., Kressel, U., Kaelberer, S.: `Robust recognition of traffic signals', Proc. 2004 IEEE Intelligent Vehicles Symposium, 2004, Parma, Italy.
    13. 13)
      • Maehlisch, M., Oberlaender, M., Loehlein, O., Gavrila, D., Ritter, W.: `A multiple detector approach to low-resolution FIR pedestrian recognition', Proc. 2005 IEEE Intelligent Vehicles Symposium, 2005, Las Vegas, USA.
    14. 14)
      • Kallenbach, I., Schweiger, R., Palm, G., Loehlein, O.: `Multi-class object detection in vision systems using a hierarchy of cascaded classifiers', Proc. 2006 IEEE Intelligent Vehicles Symposium, 2006, Tokyo, Japan.
    15. 15)
      • Walchshaeusl, L., Lindl, R., Vogel, K.: `Detection of road users in fused sensor data streams for collision mitigation', Proc. AMAA, 2006, Berlin, Germany, Advanced Microsystems for Automotive Applications 2006.
    16. 16)
      • S. Wender , T. Weiss , K. Fuerstenberg , K.C.J. Dietmayer . Feature level fusion for object classification. PReVENT ProFusion e-J. , 31 - 36

Related content

This is a required field
Please enter a valid email address