Use of feedback strategies in the detection of events for video surveillance
Use of feedback strategies in the detection of events for video surveillance
- Author(s): J.C. SanMiguel and J.M. Martínez
- DOI: 10.1049/iet-cvi.2010.0047
For access to this article, please select a purchase option:
Buy article PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
Thank you
Your recommendation has been sent to your librarian.
- Author(s): J.C. SanMiguel 1 and J.M. Martínez 1
-
-
View affiliations
-
Affiliations:
1: Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Madrid, Spain
-
Affiliations:
1: Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Madrid, Spain
- Source:
Volume 5, Issue 5,
September 2011,
p.
309 – 319
DOI: 10.1049/iet-cvi.2010.0047 , Print ISSN 1751-9632, Online ISSN 1751-9640
The authors present a feedback-based approach for event detection in video surveillance that improves the detection accuracy and dynamically adapts the computational effort depending on the complexity of the analysed data. A core feedback structure is proposed based on defining different levels of detail for the analysis performed and estimating the complexity of the data being analysed. Then, three feedback-based analysis strategies are defined (based on this core structure) and introduced in the processing stages of a typical video surveillance system. A rule-based system is designed to manage the interaction between these feedback-strategies. Experimental results show that the proposed approach slightly increases the detection reliability, whereas highly reduces the computational effort as compared to the initially developed surveillance system (without feedback strategies) across a variety of multiple video surveillance scenarios operating at real time.
Inspec keywords: feedback; computer vision; knowledge based systems; video surveillance
Other keywords:
Subjects: Image recognition; Other applications of television and video systems; Computer vision and image processing techniques; Video signal processing
References
-
-
1)
- PETS2007 Performance Evaluation of Tracking and Surveillance dataset, 2007. Available online at www.pets2007.org.
-
2)
- E. Carmona , M. Rincon , M. Bachiller , J. Martinez-Cantos , R. Martinez-Tomas , J. Mira . On the effect of feedback in multi level representation spaces for visual surveillance tasks. Neurocomputing , 916 - 927
-
3)
- O'Conaire, C., O'Connor, N., Cooke, E., Smeaton, A.: `Detection thresholding using mutual information', Proc. Int. Conf. Computer Vision Theory and Applications, 2006, p. 408–415.
-
4)
- i-Lids dataset for the Fourth IEEE Int. Conf. on Advanced Video and Signal Based Surveillance, 2007. Available online at http://www.elec.qmul.ac.uk/stanfo/andrea/avss2007.html.
-
5)
- Q. Zhou , L. Ma , D. Chelberg . Adaptive object detection and recognition based on a feedback strategy. Image Vis. Comput. , 1 , 80 - 93
-
6)
- H.-H. Nagel . Steps toward a cognitive vision system. Artif. Intell. Mag. , 2 , 31 - 50
-
7)
- S. Hongeng , R. Nevatia , F. Bremond . Video-based event recognition: activity representation and probabilistic recognition methods. Comput. Vis. Image Underst. , 2 , 129 - 162
-
8)
- Doermann, D., Mihalcik, D.: `Tools and techniques for video performances evaluation', Proc. Int. Conf. Pattern Recognition, 2000, p. 167–170.
-
9)
- SanMiguel, J.C., Martinez, J.M., Garcia, A.: `An ontology for video event detection and its application to surveillance video', Proc. IEEE Int. Conf. on Advanced Video and Signal based Surveillance, 2009, p. 220–225.
-
10)
- Rincon, M., Carmona, E., Bachiller, M., Folgado, E.: `Segmentation of moving objects with information feedback between description levels', Proc. Int. Conf. Interplay between Natural and Articial Computation, 2007, p. 171–181.
-
11)
- SanMiguel, J.C., Martinez, J.M.: `Robust unattended and stolen object detection by fusing simple algorithms', Proc. IEEE Int. Conf. Advanced Video and Signal Based Surveillance, 2008, p. 1825–1829.
-
12)
- Taycher, L., Fisher, J., Darrell, T.: `Incorporating object tracking feedback into background maintenance framework', Proc. IEEE Workshop on Motion and Video Computing, 2005, 2, p. 120–125.
-
13)
- ITEA CANDELA project test material. Available online at http://www.multitel.be/va/candela/.
-
14)
- A. Prati , I. Mikic , M. Trivedi , R. Cucchiara . Detecting moving shadows: algorithms and evaluation. IEEE Trans. Pattern Anal. Mach. Intel. , 7 , 918 - 923
-
15)
- Harville, M.: `A framework for high-level feedback to adaptive, per-pixel, mixture-of-gaussian background models', Proc. European Conf. Computer Vision, 2002, 3, p. 543–560.
-
16)
- SanMiguel, J., Martinez, J.M.: `Shadow detection in video surveillance by maximizing the agreement between independent detectors', Proc. IEEE Int. Conf. Image Processing, 2009, p. 1141–1444.
-
17)
- Tiburzi, F., Escudero, M., Bescos, J., Martinez, J.M.: `A ground truth for motion-based video-object segmentation', Proc. IEEE Int. Conf. Image Processing (Workshop on Multimedia Information Retrieval), 2008, p. 1720–1723:, Available online at http://www-vpu.ii.uam.es/CVSG/.
-
18)
- Caporossi, A., Hall, D., Reignier, P., Crowley, J.L.: `Robust visual tracking from dynamic control of processing', Proc. Int. Workshop on Performance Evaluation for Tracking and Surveillance, 2004, p. 23–32.
-
19)
- Lefevre, S., Mercier, L., Tiberghien, V., Vincent, N.: `Multiresolution color image segmentation applied to background extraction in outdoor images', Proc. IS&T European Conf. Color in Graphics, Image and Vision, 2002, p. 363–367.
-
20)
- VISOR: VIdeo Surveillance Online Repository, 2008. Available online at http://www.openvisor.org.
-
21)
- K. Toyama , G. Hager . Incremental focus of attention for robust vision-based tracking. Int. J. Comput. Vision , 1 , 45 - 63
-
22)
- R. Jain , R. Kasturi , B. Schunk . (1995) Machine vision.
-
23)
- G.F. Franklin , J.D. Powell , A. Emami-Naeini . (1991) Feedback control of dynamic systems.
-
24)
- E. Izquierdo , A. Katsaggelos , M. Strintzis . Special issue on audio and video analysis for multimedia interactive services. IEEE Trans. Circuits Syst. Video Technol. , 5 , 569 - 571
-
25)
- O'Conaire, C., O'Connor, N., Smeaton, A.: `Detector adaptation by maximising agreement between independent data sources', IEEE Int. Workshop on Object Tracking and Classification Beyond the Visible Spectrum, 2007, p. 1–6.
-
26)
- Lv, F., Song, X., Wu, B., Singh, V.K., Nevatia, R.: `Left luggage detection using bayesian inference', Proc. IEEE Int. Workshop on Performance Evaluation in Tracking and Surveillance, 2006, p. 83–90.
-
27)
- PETS2006: Performance Evaluation of Tracking and Surveillance dataset, 2006. Available online at www.pets2006.org.
-
28)
- Fernandez-Carbajales, V., Garcia, M.A., Martinez, J.M.: `Robust people detection by fusion of evidence from multiple methods', Proc. IEEE Int. Workshop on Image Analysis for Multimedia Interactive Services, 2008, p. 55–58.
-
29)
- Thales Security Systems-IST FP6 WCAM project test material. Available online at http://wcam.ep.ch/.
-
30)
- Xu, L.-Q.: `An efficient object segmentation algorithm with dynamic and selective background updating and shadow removal', Proc. IEEE Int. Conf. Image Processing, 2006, p. 2393–2396.
-
31)
- OPENCV: Open source library for computer vision. Available online at http://sourceforge.net/projects/opencv/.
-
32)
- Garcia, A., Bescos, J.: `Video object segmentation based on feedback schemes guided by a low-level scene ontology', Proc. Advanced Concepts for Intelligent Vision Systems, 2008, p. 322–333.
-
33)
- SanMiguel, J.C., Bescos, J., Martinez, J.M., Garcia, A.: `Diva: a distributed video analysis framework applied to video-surveillance systems', Proc. IEEE Int. Workshop on Image Analysis for Multimedia Interactive Services, 2008, p. 207–211.
-
34)
- A. Cavallaro , O. Steiger , T. Ebrahimi . Semantic video analysis for adaptive content delivery and automatic description. IEEE Trans. Circuits Syst. Video Technol. , 10 , 1200 - 1209
-
35)
- E. Erdem , A. Tekalp , B. Sankur . Video object tracking with feedback of performance measures. IEEE Trans. Circuits Syst. Video Technol. , 4 , 310 - 324
-
36)
- A. Cavallaro , T. Ebrahimi . Interaction between high-level and low-level image analysis for semantic video object extraction. EURASIP J. Appl. Signal Process. , 786 - 797
-
37)
- Hotz, L., Neumann, B., Terzic, K.: `High-level expectations for low-level image processing', Proc. German Conf. Articial Intelligence, 2008, p. 87–94.
-
38)
- M. Mirmehdi , P. Palmer , J. Kittler , H. Dabis . Feedback control strategies for object recognition. IEEE Trans. Image Process. , 8 , 1084 - 1101
-
1)