Vision-based traffic surveillance plays an important role in traffic management. However, outdoor illuminations, the cast shadows and vehicle variations often create problems for video analysis and processing. Thus, the authors propose a real-time cost-effective traffic monitoring system that can reliably perform traffic flow estimation and vehicle classification at the same time. First, the foreground is extracted using a pixel-wise weighting list that models the dynamic background. Shadows are discriminated utilising colour and edge invariants. Second, the foreground on a specified check-line is then collected over time to form a spatial–temporal profile image. Third, the traffic flow is estimated by counting the number of connected components in the profile image. Finally, the vehicle type is classified according to the size of the foreground mask region. In addition, several traffic measures, including traffic velocity, flow, occupancy and density, are estimated based on the analysis of the segmentation. The availability and reliability of these traffic measures provides critical information for public transportation monitoring and intelligent traffic control. Since the proposed method only process a small area close to the check-line to collect the spatial–temporal profile for analysis, the complete system is much more efficient than existing visual traffic flow estimation methods.

References

1. 1)
  - 10. Friedman, N., Russell, S.: ‘Image segmentation in video sequences: A probabilistic approach’. 13th Conf. Uncertainty in Artificial Intelligence, 1997, pp. 747–757.
2. 2)
  - 2. Morris, B., Trivedi, M.: ‘Robust classification and tracking of vehicles in traffic video streams’. IEEE Conf. Intelligent Transportation Systems, 2006, pp. 1078–1083.
3. 3)
  - 18. Fung, G., Yung, N., Pang, G., Lai, A.: ‘Towards detection of moving cast shadows for visual traffic surveillance’. IEEE Int. Conf. Systems, Man and Cybernetics, 2001, vol. 4, pp. 2505–2510.
4. 4)
  - 5. Faro, A., ordano, D., Spampinato, C.: ‘Processing web-cam images by a neuro-fuzzy approach for vehicular traffic monitoring’, World Acad. Sci., Eng. Technol., 2005, 10, pp. 300–303.
5. 5)
  - 19. Hsieh, J., Yu, S., Chen, Y., Hu, W.: ‘Automatic traffic surveillance system for vehicle tracking and classification’, IEEE Trans. Intell. Transp. Syst., 2006, 7, pp. 175–187 (doi: 10.1109/TITS.2006.874722).
6. 6)
  - 13. Ince, E.: ‘Measuring traffic flow and classifying vehicle types: A surveillance video based approach’, Turkish J. Electr. Eng. Comput. Sci., 2011, 19, (4), pp. 607–620.
7. 7)
  - 1. Ernst, I., Sujew, S., Thiessenhusen, K., Hetscher, M., Rabmann, S., Ruhe, M.: ‘LUMOS – Airborne traffic monitoring system’. Int. Conf. Intelligent Transportation System, 2003.
8. 8)
  - 22. Wang, J., Chung, Y., Chang, C., Chen, S.: ‘Shadow detection and removal for traffic images’. Int. Conf. Networking, Sensing and Control, 2004, vol. 1, pp. 649–654.
9. 9)
  - 3. Shafie, A., Ali, M., Hafiz, F., Ali, R.: ‘Smart video surveillance system for vehicle detection and traffic flow control’, J. Eng. Sci. Technol., 2011, 6, (4), pp. 469–480.
10. 10)
  - 25. Yousaf, K., Iftikhar, A., Javed, A.: ‘Comparative analysis of automatic vehicle classification techniques: a survey’, Int. J. Image Graph. Signal Process., 2012, 9, pp. 52–59 (doi: 10.5815/ijigsp.2012.09.08).
11. 11)
  - 26. Gurwicz, Y., Yehezkel, R., Lachover, B.: ‘Multiclass object classification for real-time video surveillance system’, Pattern Recognit. Lett., 2011, 32, pp. 805–815 (doi: 10.1016/j.patrec.2011.01.005).
12. 12)
  - 15. Sanin, A., Sanderson, C., Lovell, B.: ‘Shadow detection: a survey and comparative evaluation of recent methods’, Pattern Recognit., 2012, 45, (2), pp. 1684–1695 (doi: 10.1016/j.patcog.2011.10.001).
13. 13)
  - 27. Yu, G., Slotine, J.: ‘Fast wavelet-based visual classification’. Int. Conf. Pattern Recognition, 2008.
14. 14)
  - 16. Chen, C., Su, C., Kao, W.: ‘An enhanced segmentation on vision-based shadow removal for vehicle detection’. Int. Conf. Green Circuits and Systems, 2010, pp. 679–682.
15. 15)
  - 8. Rad, A., Karim, M.: ‘A robust traffic quantity measurement with video surveillance’, International J. Phys. Sci., 2011, 6, (5), pp. 962–970.
16. 16)
  - 23. Yang, M., Lo, K., Chiang, C., Tai, W.: ‘Moving cast shadow detection by exploiting multiple cues’, IET Image Process., 2008, 2, (2), pp. 95–104 (doi: 10.1049/iet-ipr:20070113).
17. 17)
  - 12. KaewTraKulPong, P., Bowden, R.: ‘An improved adaptive background mixture model for real-time tracking with shadow detection’. European Workshop on Advanced Video Based Surveillance Systems, 2001.
18. 18)
  - 29. Fawcett, T.: ‘An introduction to ROC analysis’, Pattern Recognit. Lett., 2006, 27, pp. 861–874 (doi: 10.1016/j.patrec.2005.10.010).
19. 19)
  - 4. Tai, J., Song, K.: ‘Background segmentation and its application to traffic monitoring using modified histogram’. IEEE Int. Conf. Networking, Sensing and Control, 2004, pp. 13–18.
20. 20)
  - 9. Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: ‘Wallflower: principles and practice of background maintenance’. IEEE Int. Conf. Computer Vision, 1999.
21. 21)
  - 20. Guan, Y.: ‘Spatio-temporal motion-based foreground segmentation and shadow suppression’, IET Comput. Vis., 2010, 4, (1), pp. 50–60 (doi: 10.1049/iet-cvi.2008.0016).
22. 22)
  - 6. Kiratiratanapruk, K., Siddhichai, S.: ‘Vehicle detection and tracking for traffic monitoring system’. IEEE Region 10 Conf. TENCON, 2006, pp. 1–4.
23. 23)
  - 11. Stauffer, C., Grimson, W.: ‘Learning patterns of activity using real-time tracking’, IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (8) (doi: 10.1109/34.868677).
24. 24)
  - 24. Heikkila, M., Pietikainen, M.: ‘A texture-based method for modeling the background and detecting moving object’, IEEE Trans. Pattern Anal. Mach. Intell., 2006, 28, pp. 657–662 (doi: 10.1109/TPAMI.2006.68).
25. 25)
  - 17. Jung, C.: ‘Efficient background subtraction and shadow removal for monochromatic video sequences’, IEEE Trans. Multimed., 2009, 11, (3), pp. 571–577 (doi: 10.1109/TMM.2009.2012924).
26. 26)
  - 7. Pang, C., Lam, W., Yung, N.: ‘A method for vehicle count in the presence of multiple-vehicle occlusions in traffic images’, IEEE Trans. Intell. Transp. Syst., 2007, 8, (3), pp. 441–459 (doi: 10.1109/TITS.2007.902647).
27. 27)
  - 14. Najdawi, N., Bez, H., Singhai, J., Edirisinghe, E.: ‘A survey of cast shadow detection algorithms’, Pattern Recognit. Lett., 2012, 33, pp. 752–764 (doi: 10.1016/j.patrec.2011.12.013).
28. 28)
  - 28. Computer Vision & Robotics Research Laboratory, University of California, San Diego, Aton testbed data, http://cvrr.ucsd.edu/aton/shadow/.
29. 29)
  - 21. Mikic, I., Cosman, P., Kogout, G., Trivedi, M.: ‘Moving shadow and object detection in traffic scenes’. Int. Conf. Pattern Recognition, 2000, vol. 1, pp. 321–324.

Traffic flow estimation and vehicle-type classification using vision-based spatial–temporal profile analysis

References

Related content