视觉与惯导融合的煤矿移动机器人定位方法

张羽飞, 马宏伟, 毛清华, 华洪涛, 石金龙

张羽飞,马宏伟,毛清华,等.视觉与惯导融合的煤矿移动机器人定位方法[J].工矿自动化,2021,47(3):46-52.. DOI: 10.13272/j.issn.1671-251x.2020110049
引用本文: 张羽飞,马宏伟,毛清华,等.视觉与惯导融合的煤矿移动机器人定位方法[J].工矿自动化,2021,47(3):46-52.. DOI: 10.13272/j.issn.1671-251x.2020110049
ZHANG Yufei, MA Hongwei, MAO Qinghua, HUA Hongtao, SHI Jinlong. Coal mine mobile robot positioning method based on fusion of vision and inertial navigatio[J]. Journal of Mine Automation, 2021, 47(3): 46-52. DOI: 10.13272/j.issn.1671-251x.2020110049
Citation: ZHANG Yufei, MA Hongwei, MAO Qinghua, HUA Hongtao, SHI Jinlong. Coal mine mobile robot positioning method based on fusion of vision and inertial navigatio[J]. Journal of Mine Automation, 2021, 47(3): 46-52. DOI: 10.13272/j.issn.1671-251x.2020110049

视觉与惯导融合的煤矿移动机器人定位方法

基金项目: 

国家自然科学基金重点项目(51834006)

国家自然科学基金面上项目(51975468)

详细信息
  • 中图分类号: TD67

Coal mine mobile robot positioning method based on fusion of vision and inertial navigatio

  • 摘要: 针对现有移动机器人单目视觉定位算法在光照变化和弱光照区域表现较差、无法应用于煤矿井下光照较暗场景的问题,通过非极大值抑制处理、自适应阈值调节等对快速特征点提取和描述(ORB)算法进行改进,采用随机抽样一致性(RANSAC)算法进行特征点匹配,提高了煤矿井下弱光照区域的特征点提取和匹配效率。针对仅靠单目视觉定位无法确定机器人与物体的距离及物体大小的问题,采用对极几何法对匹配好的特征点进行视觉解算,通过惯导数据为单目视觉定位提供尺度信息;根据紧耦合原理,采用图优化方法对惯导数据和单目视觉数据进行融合优化并求解,得到机器人位姿信息。实验结果表明:① ORB算法虽然提取的特征点数较少,但耗时短,且特征点分布均匀,可以准确描述物体特征。② 改进ORB算法与原ORB算法相比,虽然提取时间有了一定的增加,但提取的可用特征点数也大大增加了。③ RANSAC算法剔除了误匹配点,提高了特征点匹配的准确性,从而提高了单目视觉定位精度。④ 改进后融合定位方法精度有了很大提升,相对误差由0.6 m降低到0.4 m以下,平均误差由0.20 m减小到0.15 m,均方根误差由0.24 m减小到0.18 m。
    Abstract: The existing mobile robot monocular vision positioning algorithm performs poorly in illumination changing and weak illumination areas, and cannot be applied to dark scenes in coal mines. In order to solve these problems, the oriented FAST and rotated BRIEF (ORB) algorithm is improved by non-maximal value suppression processing and adaptive threshold adjustment. The random sample consensus (RANSAC) algorithm is used for feature point matching, which improves the efficiency of feature point extraction and matching in weak illumination areas of coal mines. In order to solve the problem that the distance between the robot and the object and the size of the object cannot be determined by monocular vision positioning alone, the epipolar geometry method is used to visually calculate the matched feature points, and the inertial navigation data is used to provide scale information for monocular visual positioning. Based on the tight coupling principle, the graph optimization method is applied to fuse, optimize and solve the inertial navigation data and monocular visual data so as to obtain the robot pose information. The experimental results show that: ① Although the number of feature points extracted is small, the ORB algorithm takes less time. The feature points, which are evenly distributed, can accurately describe the object features. ② Compared with the original ORB algorithm, the improved ORB algorithm has a certain increase in extraction time. However, the number of available feature points extracted is also greatly increased. ③ The RANSAC algorithm eliminates the mismatched points and improves the accuracy of feature point matching, thus improving the accuracy of monocular vision positioning. ④ The accuracy of the improved fusion positioning method is greatly improved, the relative error is reduced from 0.6 m to less than 0.4 m, the average error is reduced from 0.20 m to 0.15 m, and the root mean square error is reduced from 0.24 m to 0.18 m.
  • 期刊类型引用(11)

    1. 王忠宾,司垒,魏东,戴剑博,顾进恒,邹筱瑜,张聪,闫海峰,谭超. 煤矿防冲钻孔机器人全自主钻进系统关键技术. 煤炭学报. 2024(02): 1240-1258 . 百度学术
    2. 孙逍远,薄煜明. 基于多视觉传感器的矿井移动机器人目标定位模型研究. 金属矿山. 2024(11): 199-204 . 百度学术
    3. 马宏伟,苏浩,薛旭升,李超,郭逸风,王星,周文剑,崔闻达,喻祖坤,成佳帅. 煤矿井下移动机器人激光标靶定位方法研究. 煤炭科学技术. 2024(11): 60-73 . 百度学术
    4. 巩师鑫,赵国瑞,王飞. 机器视觉感知理论与技术在煤炭工业领域应用进展综述. 工矿自动化. 2023(05): 7-21 . 本站查看
    5. 李尧,桂方俊. 基于EfficientNet和LSTM的井下设备定位技术. 信息记录材料. 2023(05): 121-123+126 . 百度学术
    6. 王忠宾,司垒,王浩,张修峰,赵世豪,魏东,谭超,闫海峰. 基于空间阵列式惯性单元的防冲钻孔机器人位姿解算方法. 煤炭学报. 2022(01): 598-610 . 百度学术
    7. 司垒,王忠宾,王浩,魏东,谭超. 基于惯性传感组件和BP神经网络的防冲钻孔机器人钻具姿态解算. 仪器仪表学报. 2022(04): 213-223 . 百度学术
    8. 常波峰,郭奋超,刘欣,石超,赵国辉,范国涛. 采煤机与液压支架相对位置精确检测技术研究. 煤矿机械. 2022(10): 39-41 . 百度学术
    9. 马宏伟,晁勇,薛旭升,毛清华,王川伟. 基于双目视觉的掘锚机器人行驶位移检测方法. 工矿自动化. 2022(12): 16-25 . 本站查看
    10. 李慧. 副井井口自动化运输系统研究. 工矿自动化. 2021(06): 124-127+132 . 本站查看
    11. 赵海发. 基于视觉的煤块自动搬运系统设计. 煤炭技术. 2021(11): 205-207 . 百度学术

    其他类型引用(16)

计量
  • 文章访问数:  161
  • HTML全文浏览量:  20
  • PDF下载量:  28
  • 被引次数: 27
出版历程
  • 刊出日期:  2021-03-19

目录

    /

    返回文章
    返回