Keyframes Global Map Establishing Method for Robot Localization through Content-Based Image Matching

Abstract EN

Self-localization and mapping are important for indoor mobile robot.

We report a robust algorithm for map building and subsequent localization especially suited for indoor floor-cleaning robots.

Common methods, for example, SLAM, can easily be kidnapped by colliding or disturbed by similar objects.

Therefore, keyframes global map establishing method for robot localization in multiple rooms and corridors is needed.

Content-based image matching is the core of this method.

It is designed for the situation, by establishing keyframes containing both floor and distorted wall images.

Image distortion, caused by robot view angle and movement, is analyzed and deduced.

And an image matching solution is presented, consisting of extraction of overlap regions of keyframes extraction and overlap region rebuild through subblocks matching.

For improving accuracy, ceiling points detecting and mismatching subblocks checking methods are incorporated.

This matching method can process environment video effectively.

In experiments, less than 5% frames are extracted as keyframes to build global map, which have large space distance and overlap each other.

Through this method, robot can localize itself by matching its real-time vision frames with our keyframes map.

Even with many similar objects/background in the environment or kidnapping robot, robot localization is achieved with position RMSE <0.5 m.