Multi-aircrafts tracking using spatial–temporal constraints-based intra-frame scale-invariant feature transform feature matching

Zehua Xie; Zhenzhong Wei; Chen Bai

Multi-aircrafts tracking using spatial–temporal constraints-based intra-frame scale-invariant feature transform feature matching

View Fulltext

Author(s): Zehua Xie ¹ ; Zhenzhong Wei ¹ ; Chen Bai ¹
- Affiliations: 1: Key Laboratory of Precision Opto-Mechatronics Technology, Ministry of Education Beihang University, Beijing, People's Republic of China
Source: Volume 9, Issue 6, December 2015, p. 831 – 840
DOI: 10.1049/iet-cvi.2014.0403 , Print ISSN 1751-9632, Online ISSN 1751-9640

This is an open access article published by the IET under the Creative Commons Attribution -NonCommercial License (http://creativecommons.org/licenses/by-nc/3.0/)

Received 19/07/2014, Accepted 31/03/2015, Revised 05/03/2015, Published 01/12/2015

Although multi-objects tracking has been improved significantly, tracking multiple aircrafts with nearly the same appearance remains a difficult task, especially when a significant pose changes and long-time occlusions occur in the complex environment. In this study, the authors propose a new multi-aircrafts tracker based on a structured support vector machine (SVM) and an intra-frame scale-invariant feature transform feature matching. The structured SVM-based model adapts to the appearance change well, but confuses different aircrafts when occlusions between aircrafts occur. To handle occlusions, an intra-frame matching method is applied to separate different aircrafts by matching points into different clusters. Moreover, to remove the mismatching caused by the cluttered background, the spatial–temporal constraint is applied to help improve the performance of the intra-frame feature matching. As there is no dataset to evaluate a multi-aircrafts tracker, they select eighteen challenging videos and manually annotate the ground truth, forming the first multi-aircrafts tracking dataset. The experiments in the dataset demonstrate that the author's tracker outperforms the state-of-the-art trackers in multi-aircrafts tracking.

References

1. 1)
  - 16. Tsochantaridis, I., Joachims, T., Hofmann, T., Altun, Y.: ‘Large margin methods for structured and interdependent output variables’, J. Mach. Learn. Res., 2005, 6, pp. 1453–1484.
2. 2)
  - 3. Dimitropoulos, K., Grammalidis, N., Simitopoulos, D., Pavlidou, N., Strintzis, M.: ‘Aircraft detection and tracking using intelligent cameras’. IEEE Int. Conf. on Image Processing, Genoa, Italy, September 2005, pp. 1941–1944.
3. 3)
  - 20. Ke, Y., Sukthankar, R.: ‘PCA-SIFT: A more distinctive representation for local image descriptors’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Washington, USA, July 2004, pp. 506–513.
4. 4)
  - 7. Benfold, B., Reid, I.: ‘Stable multi-target tracking in real-time surveillance video’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Colorado Springs, USA, June 2011, pp. 3457–3464.
5. 5)
  - 37. Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Gool, L.V.: ‘Online multi-person tracking-by-detection from a single, uncalibrated camera’, IEEE Trans. Pattern Anal. Mach. Intell., 2010, 33, (9), pp. 1820–1833 (doi: 10.1109/TPAMI.2010.232).
6. 6)
  - 1. Wren, L., Dwyer, D., Thornton, J., Bonsor, N.: ‘Aircraft tracking and logging for commercial airports’. Conf. on Acquisition, Tracking, and Pointing, Orlando, USA, July 2002, pp. 20–32.
7. 7)
  - 22. Chen, A.H., Zhu, M., Wang, Y.H., Xue, C.: ‘Mean shift tracking combining SIFT’. IEEE Int. Conf. on Signal Processing, Beijing, China, October 2008, pp. 1532–1535.
8. 8)
  - 18. Bordes, A., Bottou, L., Gallinari, P., Weston, J.: ‘Solving multiclass support vector machines with LaRank’. Proc. Int. Conf. on Machine Learning, New York, USA, June 2007, pp. 89–96.
9. 9)
  - 14. Hare, S., Saffari, A., Torr, P.H.: ‘Struck: Structured output tracking with kernels’. Proc. IEEE Int. Conf. on Computer Vision, Barcelona, Spain, November 2011, pp. 263–270.
10. 10)
  - 19. Yi, Z., Zhiguo, C., Yang, X.: ‘Multi-spectral remote image registration based on SIFT’, Electron. Lett., 2008, 44, (2), pp. 107–108 (doi: 10.1049/el:20082477).
11. 11)
  - 2. Filis, D.P., Renios, C.I.: ‘Aircraft recognition and tracking device’. Conf. on Electro-Optical and Infrared Systems – Technology and Applications, Prague, Czech Republic, September 2011, pp. 81850Q–81850Q.
12. 12)
  - 5. Kuo, C.H., Huang, C., Nevatia, R.: ‘Multi-target tracking by on-line learned discriminative appearance models’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, USA, June 2010, pp. 685–692.
13. 13)
  - 8. Yang, B., Nevatia, R.: ‘Multi-target tracking by online learning of non-linear motion patterns and robust appearance model’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Providence, USA, June 2012, pp. 1918–1925.
14. 14)
  - 4. Doyle, D.D., Alan, L.J., Jonathan, T.B.: ‘Optical flow background subtractions for real-time PTZ camera object tracking’. IEEE Int. Instrumentation and Measurement Technology Conf., Minneapolis USA, May 2013, pp. 866–871.
15. 15)
  - 21. Zhou, H., Yuan, Y., Shi, C.: ‘Object tracking using SIFT features and mean shift’, Comput. Vis. Image Understand., 2009, 113, (3), pp. 345–352 (doi: 10.1016/j.cviu.2008.08.006).
16. 16)
  - 25. Zhang, L., van der Maaten, L.: ‘Preserving structure in model-free tracking’, IEEE Trans. Pattern Anal. Mach. Intell., 2014, 36, (4), pp. 756–769 (doi: 10.1109/TPAMI.2013.221).
17. 17)
  - 12. Khan, Z., Balch, T., Dellaert, F.: ‘MCMC data association and sparse factorization updating for real time multitarget tracking with merged and multiple measurements’, IEEE Trans. Pattern Anal. Mach. Intell., 2006, 28, (12), pp. 1960–1972 (doi: 10.1109/TPAMI.2006.247).
18. 18)
  - 17. Lowe, D.G.: ‘Object recognition from local scale-invariant features’. Proc. IEEE Int. Conf. on Computer Vision, Kerkyra, Greece, September 1999, pp. 1150–1157.
19. 19)
  - 6. Yang, B., Huang, C., Nevatia, R.: ‘Learning affinities and dependencies for multi-target tracking using a CRF models’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Colorado Springs, USA, June 2011, pp. 1233–1240.
20. 20)
  - 23. Xing, J., Ai, H., Lao, S.: ‘Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, USA, June 2009, pp. 1200–1207.
21. 21)
  - 24. Kalal, Z., Mikolajczyk, K., Matas, J.: ‘Tracking-learning-detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, (7), pp. 1409–1422 (doi: 10.1109/TPAMI.2011.239).
22. 22)
  - 13. Poiesi, F., Mazzon, R., Cavallaro, A.: ‘Multi-target tracking on confidence maps: An application to people tracking’, Comput. Vis. Image Understand., 2013, 117, (10), pp. 1257–1272 (doi: 10.1016/j.cviu.2012.08.008).
23. 23)
  - 10. Yang, M., Lv, F., Xu, W., Gong, Y.: ‘Detection driven adaptive multi-cue integration for multiple human tracking’. Proc. IEEE Int. Conf. on Computer Vision, Kyoto, Japan, September 2009, pp. 1554–1561.
24. 24)
  - 11. Xing, J., Ai, H., Lao, S.: ‘Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Miami, USA, June 2009, pp. 1200–1207.
25. 25)
  - 15. Wu, Y., Lim, J., Yang, M.H.: ‘Online object tracking: A benchmark’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Portland, USA, June 2013, pp. 2411–2418.

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Multi-aircrafts tracking using spatial–temporal constraints-based intra-frame scale-invariant feature transform feature matching

References

Related content