Appearance-based approach to hybrid metric-topological simultaneous localisation and mapping
- Author(s): Lorenzo Fernández 1 ; Luis Payá 1 ; Oscar Reinoso 1 ; Luis Miguel Jimenez 1
-
-
View affiliations
-
Affiliations:
1:
Departamento de Ingeniería de Sistemas Industriales, Universidad Miguel Hernández, Avda. de la Universidad s/n, 03202, Elche, Alicante, Spain
-
Affiliations:
1:
Departamento de Ingeniería de Sistemas Industriales, Universidad Miguel Hernández, Avda. de la Universidad s/n, 03202, Elche, Alicante, Spain
- Source:
Volume 8, Issue 8,
December 2014,
p.
688 – 699
DOI: 10.1049/iet-its.2013.0086 , Print ISSN 1751-956X, Online ISSN 1751-9578
- « Previous Article
- Table of contents
- Next Article »
In this study a unified framework to carry out the simultaneous localisation and mapping of a mobile robot combining metric and topological techniques is presented. The robot moves in a real indoor environment and the algorithm makes use of the information provided by an omnidirectional camera mounted on the robot and its internal odometry. The hybrid approach consists in constructing simultaneously two maps of the environment, one metric and other topological with relationships between them which are updated in each step. The robot goes through the environment to build up a map while continuously captures images. To build the topological map the most relevant information from the scenes is extracted using a global appearance descriptor. A new node is added to the map when the appearance between two images is sufficiently different. Also, the authors check if there is a loop closure with a previous node. At the same time, a metrical map of the environment is computed. With this aim, the authors estimate the position of the robot when it captures a new image using a Monte–Carlo algorithm. The authors show how it is possible to obtain a reasonable performance both in time and accuracy in an indoor environment, when the involved parameters are properly tuned.
Inspec keywords: Monte Carlo methods; robot vision; feature extraction; SLAM (robots); mobile robots; cameras
Other keywords: hybrid metric-topological simultaneous localisation and mapping; position estimation; internal odometry; indoor environment; loop closure; global appearance descriptor; appearance-based approach; scene extraction; Monte-Carlo algorithm; mobile robot; omnidirectional camera
Subjects: Monte Carlo methods; Computer vision and image processing techniques; Monte Carlo methods; Image sensors; Image recognition; Mobile robots
References
-
-
1)
-
14. Montemerlo, M., Thrun, S.: ‘Simultaneous localization and mapping with unknown data association using FastSLAM’. Proc. of IEEE International Conference on Robotics and Automation, Taipei, Taiwan, 2003, vol. 2, pp. 1985–1991.
-
-
2)
- D.G. Lowe . Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis , 2 , 91 - 110
-
3)
-
29. Harris, C.G., Stephens, M.: ‘A combined corner and edge detector’. Proc. of Alvey Vision Conference, 1998, pp. 147–151.
-
-
4)
-
49. Smith, A.F.M., Gelfand, A.E.: ‘Bayesian statistics without tears: a sampling-resampling perspective’, Am. Stat., 1992, 46, (2), pp. 84–88.
-
-
5)
-
32. Pretto, A., Menegatti, E., Pagello, E., Jitsukawa, Y., Ueda, R., Arai, T.: ‘Toward image-based localization for AIBO using wavelet transform’. Proc. Artificial Intelligence and Human-Oriented Computing, Berlin, Heidelberg, 2007, pp. 831–838.
-
-
6)
-
34. Rossi, F., Ranganathan, A., Dellaert, F., Menegatti, E.: ‘Toward topological localization with spherical Fourier transform and uncalibrated camera’. Proc. Int. Conf. on Simulation, Modeling and Programming for Autonomous Robots, Venice, Italy, 2008, pp. 319–330.
-
-
7)
-
4. Thrun, S., Liu, Y., Koller, D., Ng, A., Ghahramani, Z., Durrant-Whyte, H.: ‘Simultaneous Localization and mapping with sparse extended information filters’, Int. J. Robot. Research, 2004, 23, (7/8), pp. 693–716 (doi: 10.1177/0278364904045479).
-
-
8)
-
24. Valgren, C., Lilienthal, A.: ‘SIFT, SURF and seasons: long-term outdoor localization using local features’. Proc. European Conf. on Mobile Robots, Freiburg, Germany, 2007, pp. 253–258.
-
-
9)
-
36. Amorós, F., Payá, L., Reinoso, Ó., Fernández, L., Marín, J.M.: ‘Visual map building and localization with an appearance-based approach. Comparisons of techniques to extract information of panoramic images’. Proc. Int. Conf. on Informatics in Control, Automation and Robotics, Madeira, Portugal, 2010, pp. 423–426.
-
-
10)
-
17. Gil, A., Reinoso, O., Pay, L., Ballesta, M., Pedrero, J.: ‘Managing data association in visual SLAM using SIFT features’, International Journal of Factory Automation, Robotics and Soft Computing, 2007, 1, pp. 179–184.
-
-
11)
-
27. Barfoot, T.D.: ‘Online Visual Motion Estimation using FastSLAM with SIFT Features’. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems. Edmonton, s, 2005, pp. 579–585.
-
-
12)
-
30. Jogan, M., Leonardis, A.: ‘Robust localization using eigenspace of spinning-images’. Proc. IEEE Workshop on Omnidirectional Vision. Hilton Head Island, USA, 2000, pp. 37–44.
-
-
13)
-
43. Gonzalez, R., Wintz, P.: ‘Digital image processing’ (Addison, 1987).
-
-
14)
-
45. Fernandez, L., Paya, L., Reinoso, O., Gil, A., Julia, M., Ballesta, M.: ‘Robust methods for robot localization under changing illumination conditions. Comparison of different filtering techniques’. Proc. Int. Conf. on Agents and Artificial Intelligence, Valencia, Spain, 2010, vol. 1, pp. 223–228.
-
-
15)
-
5. Diosi, A., Kleeman, L.: ‘Advanced sonar and laser range finder fusion for simultaneous localization and mapping’. Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2, Sendai, Japan, 2004, pp. 1854–1859.
-
-
16)
-
6. Angeli, A., Doncieux, S., Meyer, J., Filliat, D.: ‘Visual topological SLAM and global localization’. Proc. of IEEE International Conference on Robotics and Automation, Piscataway, NJ, USA, 2009, pp. 2029–2034.
-
-
17)
-
52. Seber, G.: ‘Multivariate observations’ (Wiley Interscience, 1984).
-
-
18)
-
1. Smith, R., Self, M., Cheeseman, P.: ‘A stochastic map for uncertain spatial relationships’. Proc. Fourth Int. Symp.. Cambridge, MA, USA, 1988, pp. 467–474..
-
-
19)
-
18. Lui, W., Jarvis, R.: ‘A pure vision-based approach to topological SLAM’. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Taipei, Taiwan, 2010, pp. 3784–3791.
-
-
20)
-
19. Thrun, S., Montemerlo, M.: ‘The GraphSLAM algorithm with applications to large-scale mapping of urban structures’, Int. J. Robot. Res., 2006, 25, (5), pp. 403–430 (doi: 10.1177/0278364906065387).
-
-
21)
-
9. Motard, E., Raducanu, B., Cadenat, V., Vitrià, J.: ‘Incremental on-line topological map learning for a visual homing application’. Proc. of IEEE International Conference on Robotics and Automation, 2007, pp. 2049–2054.
-
-
22)
-
12. Blanco, J.L., Fernandez, J.A., Gonzalez, J.: ‘A new approach for large-scale localization and mapping: hybrid metric-topological SLAM’. Proc. of the IEEE International Conference on Robotics and Automation, 2007, pp. 2061–2067.
-
-
23)
-
2. Tully, S., Moon, H., Kantor, G., Choset, H.: ‘Iterated filters for bearing-only SLAM’. Proc. IEEE Int. Conf. on Robotics and Automation (ICRA). Pasadena, California, USA, 2008, pp. 1442–1448.
-
-
24)
-
11. Tully, S., Moon, H., Morales, D., Kantor, G., Choset, H.: ‘Hybrid localization using the hierarchical atlas’. Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, pp. 2857–2864.
-
-
25)
-
37. Amorós, F., Payá, L., Reinoso, Ó., Jiménez, L.M.: ‘Comparison of global-appearance techniques applied to visual map building and localization’. Proc. Int. Conf. on Computer Vision Theory and Applications, Rome, Italy, 2012, vol. 2, pp. 395–398.
-
-
26)
-
35. Paya, L., Fernandez, L., Gil, A., Reinoso, O.: ‘Map building and Monte Carlo localization using global appearance of omnidirectional images’, Sensors, 2010, 10, (12), pp. 11468–11497 (doi: 10.3390/s101211468).
-
-
27)
-
38. Tomatis, N., Nourbakhsh, I., Siegwart, R.: ‘Hybrid simultaneous localization and map building: a natural integration of topological and metric’, Robot. Auton. Syst., 2003, 44, (1), pp. 3–14 (doi: 10.1016/S0921-8890(03)00006-X).
-
-
28)
-
46. Valiente, D., Fernandez, L., Aparicio, A.G., Castello, L.P., Garcia, O.R.: ‘Visual Odometry through appearance and feature-based method with omnidirectional images’, J. Robot., 2012, 2012, pp. 13–0.
-
-
29)
- M.A. Fischler , R.C. Bolles . Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM , 381 - 395
-
30)
-
47. Fox, D., Burgard, W., Thrun, S.: ‘Markov localization for mobile robots in dynamic environments’, J. Artif. Intell. Res., 1999, 11, pp. 391–427.
-
-
31)
-
23. Murillo, A.C., Guerrero, J.J., Sagüés, C.: ‘SURF features for efficient robot localization with omnidirectional images’. Proc. IEEE Int. Conf. on Robotics and Automation, San Diego, CA, USA, 2007, pp. 3901–3907.
-
-
32)
-
50. ROS. http://www.ros.org, 2012.
-
-
33)
-
33. Lui, W.L.D., Jarvis, R.: ‘A pure vision-based topological SLAM system’, Int. J. Robot. Res., 2012, 31, (4), pp. 403–428 (doi: 10.1177/0278364911435160).
-
-
34)
-
3. Dissanayake, G., Newman, P., Clark, S., et al: ‘A solution to the simultaneous localization and map building (SLAM) problem’, IEEE Trans. Robot. Autom., 2001, 17, (3), pp. 229–241 (doi: 10.1109/70.938381).
-
-
35)
-
44. Menegatti, E., Maeda, T., Ishiguro, H.: ‘Image-based memory for robot navigation using properties of omnidirectional images’, Robot. Auton. Syst., 2004, 47, (4), pp. 251–276 (doi: 10.1016/j.robot.2004.03.014).
-
-
36)
-
20. Tully, S., Kantor, G., Choset, H., Werner, F.: ‘A multi-hypothesis topological SLAM approach for loop closing on edge-ordered graphs’. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Piscataway, NJ, USA, 2009, pp. 4943–4948.
-
-
37)
-
13. Murillo, A.C., Sagüés, C., Guerrero, J.J., Goedemé, T., Tuytelaars, T., Van Gool, L.: ‘From omnidirectional images to hierarchical localization’, Robotics and Autonomous Systems, 2007, 55, (5), pp. 372–382 (doi: 10.1016/j.robot.2006.12.004).
-
-
38)
-
31. Paya, L., Fernandez, L., Reinoso, O., Gil, A., Ubeda, D.: ‘Appearance-based dense maps creation. Comparison of compression techniques with panoramic images’. Proc. Int. Conf. on Informatics in Control, Automation and Robotics, Milan, Italy, 2009, pp. 238–246.
-
-
39)
-
28. Gil, A., Reinoso, O., Vicente, A., Fernández, C., Payá, L.: ‘Monte Carlo localization using SIFT features’. Pattern Recognition and Image Analysis, (3522> LCNS), 2005, pp. 623–630.
-
-
40)
-
15. Hähnel, D., Burgard, W., Fox, D., Thrun, S.: ‘An efficient FastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements’. Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, NV, USA, 2003, pp. 206–211.
-
-
41)
-
41. Wu, J., Christensen, H.I., Rehg, J.M.: ‘Visual place categorization: problem, dataset, and algorithm’. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, St. Louis, USA, 2009, pp. 4763–4770.
-
-
42)
-
51. Stachniss, C., Grisetti, G., Hähnel, D., Burgard, W.: ‘Improved Rao-Blackwellized mapping by adaptive sampling and active loop-closure’. Proc. Workshop on Self-Organization of Adaptive Behavior. Ilmenau, Germany, 2004, pp. 1–15.
-
-
43)
-
42. Folkesson, J., Christensen, H.: ‘Outdoor exploration and SLAM using a compressed filter’. Proc. IEEE Int. Conf. on Robotics and Automation, Taipei, Taiwan, 2003, vol. 1, pp. 419–426.
-
-
44)
-
21. Tully, S., Kantor, G., Choset, H.: ‘A unified bayesian framework for global localization and SLAM in hybrid metric/topological maps’, Int. J. Robot. Res., 2012, 31, (3), pp. 271–288 (doi: 10.1177/0278364911433617).
-
-
45)
-
39. Marinakis, D., Dudek, G.: ‘Pure topological mapping in mobile robotics’, IEEE Trans. Robot., 2010, 26, (6), pp. 1051–1064 (doi: 10.1109/TRO.2010.2081410).
-
-
46)
-
8. Romero, A., Cazorla, M.: ‘Topological SLAM using omnidirectional images: merging feature detectors and graph-matching’, in: Blanc-Talon, J., Bone, D., Philips, W., Popescu, D., Scheunders, P., (Eds.), ‘Advanced concepts for intelligent vision systems’, (6474LNCS). Springer, Berlin, Heidelberg, 2010, pp. 464–475.
-
-
47)
-
10. Ranganathan, A., Menegatti, E., Dellaert, F.: ‘Bayesian inference in the space of topological maps’, IEEE Transactions on Robotics, 2006, 22, (1), pp. 92–107 (doi: 10.1109/TRO.2005.861457).
-
-
48)
- H. Bay , A. Ess , T. Tuytelaars , L.V. Gool . SURF: speeded up robust features. Comput. Vis. Image Underst. , 3 , 346 - 359
-
49)
- S. Thrun , D. Fox , W. Burgard , F. Dellaert . Robust Monte Carlo localization for mobile robots. Artif. Intell. , 1 , 99 - 141
-
50)
-
7. Lisien, B., Morales, D.D.S., Kantor, G., Rekleitis, I., Choset, H.: ‘The hierarchical atlas’, IEEE Transactions on Robotics, 2005, 21, (3), pp. 473–481 (doi: 10.1109/TRO.2004.837237).
-
-
51)
- A. Gil , Ó. Reinoso , M. Ballesta , M. Juliá . Multi-robot visual SLAM using a Rao-Blackwellized particle filter. Robot. Auton. Syst. J. , 1 , 68 - 80
-
1)