Research on key technologies of intelligent gangue sorting robot

ZHANG Yuanhao; PAN Xiangsheng; CHEN Xiaojing; HUO Zhenlong; REN Shuwen; JI Liang

doi:10.13272/j.issn.1671-251x.17931

Volume 48 Issue 6

Jun. 2022

Turn off MathJax

Article Contents

Article Navigation > Journal of Mine Automation > 2022 > 48(6): 69-76, 111

ZHANG Yuanhao, PAN Xiangsheng, CHEN Xiaojing, et al. Research on key technologies of intelligent gangue sorting robot[J]. Journal of Mine Automation，2022，48(6)：69-76, 111. doi: 10.13272/j.issn.1671-251x.17931

Citation:

PDF( 2374 KB)

Research on key technologies of intelligent gangue sorting robot

doi: 10.13272/j.issn.1671-251x.17931

ZHANG Yuanhao^{1, 2
,},
PAN Xiangsheng^{1, 2},
CHEN Xiaojing^{1, 2},
HUO Zhenlong^{1, 2},
REN Shuwen^{1, 2},
JI Liang^{1, 2}

1.
CCTEG Changzhou Research Institute, Changzhou 213015, China
2.
Tiandi(Changzhou) Automation Co., Ltd., Changzhou 213015, China

Received Date: 2022-04-12
Rev Recd Date: 2022-06-05

Available Online: 2022-06-28

Abstract

Abstract

This paper introduces the application and research status of the intelligent gangue sorting robot. This paper points out that the intelligent gangue sorting robot is mainly based on the principle of X-ray and image identification. And the high-pressure pneumatic sorting and truss robot grasping sorting are used to separate coal and gangue. The sorting actuators are mainly truss type, parallel type and series type of intelligent gangue sorting robot. The sorting actuators have fast response speed and often separate the gangue in the form of 'pulling' and 'grasping'. In the process of belt transportation, the compatibility of different gangue sizes and the optimization of movement path need to be considered in the 'pulling' of the intelligent gangue sorting robot. And the working space of the manipulator and the bearing capacity of the robot need to be considered in the 'grasping'. This paper analyzes the key technologies such as deep learning-based coal and gangue identification, unstructured multi-constraint environment-oriented motion planning of gangue sorting manipulator, force feedback-based active compliance control of manipulator and multi-arm cooperative sorting task allocation strategy and control. These technologies are used for intelligent gangue sorting robot to effectively realize gangue sorting in complex on-site environment. This paper points out that coal and gangue identification technology based on deep learning is one of the key technologies of gangue sorting robot. It still needs further research on the efficient construction method of coal gangue data set, improving the generalization of coal gangue identification algorithm, and the real-time optimization of coal gangue identification algorithm. Combined with the demand of field application and intelligent robot development, the future research directions of intelligent gangue sorting robot are pointed out. In the complex environment on site, it is suggested to improve the robustness and adaptability of the coal gangue identification algorithm. It is suggested to develop intelligent sensing and control technology for complex environment and high-precision three-dimensional pose estimation technology for gangue. It is suggested to develop intelligent gangue picking technology of gangue picking robot based on force position hybrid control. It is suggested to research intelligent gangue sorting robot underground gangue sorting technology.
- intelligent gangue sorting robot,
- gangue sorting,
- image identification,
- identification of coal gangue,
- mechanical arm,
- motion planning,
- intelligent perception and control,
- task allocation policy

FullText(HTML)

References(36)

References

[1]	葛世荣,胡而已,裴文良. 煤矿机器人体系及关键技术[J]. 煤炭学报,2020,45(1):455-463. GE Shirong,HU Eryi,PEI Wenliang. Classification system and key technology of coal mine robot[J]. Journal of China Coal Society,2020,45(1):455-463.
[2]	王国法,范京道,徐亚军,等. 煤炭智能化开采关键技术创新进展与展望[J]. 工矿自动化,2018,44(2):5-12. WANG Guofa,FAN Jingdao,XU Yajun,et al. Innovation process and prospect on key technologies of intelligent coal mining[J]. Industry and Mine Automation,2018,44(2):5-12.
[3]	刘园园. “十四五”能源领域科技创新规划[N]. 科技日报, 2022-04-06（1）. LIU Yuanyuan. The 14th Five-Year Plan for energy science and technological innovation[N]. Science and Technology Daily, 2022-04-06（1）.
[4]	葛世荣. 煤矿机器人现状及发展方向[J]. 中国煤炭,2019,45(7):18-27. doi: 10.3969/j.issn.1006-530X.2019.07.004 GE Shirong. Present situation and development direction of coal mine robots[J]. China Coal,2019,45(7):18-27. doi: 10.3969/j.issn.1006-530X.2019.07.004
[5]	胡而已,葛世荣. 煤矿机器人研发进展与趋势分析[J]. 智能矿山,2021,2(1):59-74. HU Eryi,GE Shirong. Coal mining robot research progress and trend analysis[J]. Journal of Intelligent Mine,2021,2(1):59-74.
[6]	黄邦松. TDS智能干选机在双柳煤矿的应用[J]. 中国煤炭,2020,46(3):47-50. doi: 10.3969/j.issn.1006-530X.2020.03.008 HUANG Bangsong. Application of the TDS intelligent dry separator at Shuangliu Coal Mine[J]. China Coal,2020,46(3):47-50. doi: 10.3969/j.issn.1006-530X.2020.03.008
[7]	江洪,宋勇,隋国成,等. 智能选矸机器人系统的研究与应用[J]. 选煤技术,2020(4):81-87. JIANG Hong,SONG Yong,SUI Guocheng,et al. Study and application of the intelligent robotic gangue picking system[J]. Coal Preparation Technology,2020(4):81-87.
[8]	朱道瑶,梁殿印,史佩伟,等. 矿石拣选技术和设备的研究和进展[J]. 矿山机械,2016,44(7):5-10. ZHU Daoyao,LIANG Dianyin,SHI Peiwei,et al. Research and development of ore sorting technology and equipments[J]. Mining & Processing Equipment,2016,44(7):5-10.
[9]	王鹏,曹现刚,夏晶,等. 基于机器视觉的多机械臂煤矸石分拣机器人系统研究[J]. 工矿自动化,2019,45(9):47-53. WANG Peng,CAO Xiangang,XIA Jing,et al. Research on multi-manipulator coal and gangue sorting robot system based on machine vision[J]. Industry and Mine Automation,2019,45(9):47-53.
[10]	赵明辉,宣鹏程,张少宾. 并联煤矸石分拣机器人的结构设计及分析[J]. 机床与液压,2021,49(5):55-59. ZHAO Minghui,XUAN Pengcheng,ZHANG Shaobin. Structure design and analysis for parallel gangue sorting robot[J]. Machine Tool & Hydraulics,2021,49(5):55-59.
[11]	商德勇,章林,牛艳奇,等. 煤矸分拣机器人设计与关键技术分析[J]. 煤炭科学技术,2022,50(3):232-238. SHANG Deyong,ZHANG Lin,NIU Yanqi,et al. Design and key technology analysis of coal-gangue sorting robot[J]. Coal Science and Technology,2022,50(3):232-238.
[12]	袁华昕. 基于X射线图像的煤矸石智能分选控制系统研究[D]. 沈阳: 东北大学, 2014. YUAN Huaxin. Research on coal and gangue smart sorting control system based on X-ray image[D]. Shenyang: Northeastern University, 2014.
[13]	李曼,段雍,曹现刚,等. 煤矸分选机器人图像识别方法和系统[J]. 煤炭学报,2020,45(10):3636-3644. LI Man,DUAN Yong,CAO Xiangang,et al. Image identification method and system for coal and gangue sorting robot[J]. Journal of China Coal Society,2020,45(10):3636-3644.
[14]	曹现刚,费佳浩,王鹏,等. 基于多机械臂协同的煤矸分拣方法研究[J]. 煤炭科学技术,2019,47(4):7-12. CAO Xiangang,FEI Jiahao,WANG Peng,et al. Study on coal-gangue sorting method based on multi- manipulator collaboration[J]. Coal Science and Technology,2019,47(4):7-12.
[15]	李阳阳. 长平公司洗煤厂智能煤矸分选机器人技术研究[J]. 机械管理开发,2022,37(1):221-222. LI Yangyang. Intelligent gangue sorting robot technology research in Changping Coal Washing Plant[J]. Mechanical Management and Development,2022,37(1):221-222.
[16]	宋文革,陶亚东,齐成军,等. 智能机器人拣矸系统的设计研究[J]. 煤炭加工与综合利用,2018(9):5-8. SONG Wenge,TAO Yadong,QI Chengjun,et al. Design and research of intelligent robot gangue picking system[J]. Coal Processing & Comprehensive Utilization,2018(9):5-8.
[17]	马宪民,蒋勇. 煤与矸石识别的数字图像处理方法探讨[J]. 煤矿机电,2004,25(5):9-11. doi: 10.3969/j.issn.1001-0874.2004.05.004 MA Xianmin,JIANG Yong. Digital image processing method of coal gangues[J]. Colliery Mechanical & Electrical Technology,2004,25(5):9-11. doi: 10.3969/j.issn.1001-0874.2004.05.004
[18]	何敏,王培培,蒋慧慧. 基于SVM和纹理的煤和煤矸石自动识别[J]. 计算机工程与设计,2012,33(3):1117-1121. doi: 10.3969/j.issn.1000-7024.2012.03.055 HE Min,WANG Peipei,JIANG Huihui. Recognition of coal and stone based on SVM and texture[J]. Computer Engineering and Design,2012,33(3):1117-1121. doi: 10.3969/j.issn.1000-7024.2012.03.055
[19]	孙继平,佘杰. 基于支持向量机的煤岩图像特征抽取与分类识别[J]. 煤炭学报,2013,38(增刊2):508-512. SUN Jiping,SHE Jie. Coal-rock image-feature extraction and recognition based on support vector machine[J]. Journal of China Coal Society,2013,38(S2):508-512.
[20]	LI Lihong,WANG Haijiang,AN Lei. Research on recognition of coal and gangue based on image processing[J]. World Journal of Engineering,2015,12(3):247-253. doi: 10.1260/1708-5284.12.3.247
[21]	李莹. 基于深度学习的煤矸石目标检测方法研究[D]. 西安: 西安科技大学, 2020. LI Ying. Research on coal gangue detection based on deep learning[D]. Xi'an: Xi'an University of Science and Technology, 2020.
[22]	曹现刚,李莹,王鹏,等. 煤矸石识别方法研究现状与展望[J]. 工矿自动化,2020,46(1):38-43. CAO Xiangang,LI Ying,WANG Peng,et al. Research status of coal-gangue identification method and its prospect[J]. Industry and Mine Automation,2020,46(1):38-43.
[23]	曹现刚,刘思颖,王鹏,等. 面向煤矸分拣机器人的煤矸识别定位系统研究[J]. 煤炭科学技术,2022,50(1):237-246. CAO Xiangang,LIU Siying,WANG Peng,et al. Research on coal gangue identification and positioning system based on coal-gangue sorting robot[J]. Coal Science and Technology,2022,50(1):237-246.
[24]	郜亚松,张步勤,郎利影. 基于深度学习的煤矸石识别技术与实现[J]. 煤炭科学技术,2021,49(12):202-208. GAO Yasong,ZHANG Buqin,LANG Liying. Coal and gangue recognition technology and implementation based on deep learning[J]. Coal Science and Technology,2021,49(12):202-208.
[25]	沈科,季亮,张袁浩,等. 基于改进YOLOv5s模型的煤矸目标检测[J]. 工矿自动化,2021,47(11):107-111,118. SHEN Ke,JI Liang,ZHANG Yuanhao,et al. Research on coal and gangue detection algorithm based on improved YOLOv5s model[J]. Industry and Mine Automation,2021,47(11):107-111,118.
[26]	谭建荣. 智能制造与机器人应用关键技术与发展趋势[J]. 机器人技术与应用,2017(3):18-19. doi: 10.3969/j.issn.1004-6437.2017.03.007 TAN Jianrong. Key technologies and development trends of intelligent manufacturing and robot applications[J]. Robot Technique and Application,2017(3):18-19. doi: 10.3969/j.issn.1004-6437.2017.03.007
[27]	李黎,尚俊云,冯艳丽,等. 关节型工业机器人轨迹规划研究综述[J]. 计算机工程与应用,2018,54(5):36-50. doi: 10.3778/j.issn.1002-8331.1712-0116 LI Li,SHANG Junyun,FENG Yanli,et al. Research of trajectory planning for articulated industrial robot:a review[J]. Computer Engineering and Applications,2018,54(5):36-50. doi: 10.3778/j.issn.1002-8331.1712-0116
[28]	夏群峰,彭勇刚. 基于视觉的机器人抓取系统应用研究综述[J]. 机电工程,2014,31(6):697-701,710. XIA Qunfeng,PENG Yonggang. Review on application research of robots scraping system based on visual[J]. Journal of Mechanical & Electrical Engineering,2014,31(6):697-701,710.
[29]	贾丙西,刘山,张凯祥,等. 机器人视觉伺服研究进展:视觉系统与控制策略[J]. 自动化学报,2015,41(5):861-873. JIA Bingxi,LIU Shan,ZHANG Kaixiang,et al. Survey on robot visual servo control:vision system and control strategies[J]. Acta Automatica Sinica,2015,41(5):861-873.
[30]	赵明辉. 双臂并联煤矸石分拣机器人及其轨迹规划研究[J]. 工矿自动化,2020,46(9):57-63. ZHAO Minghui. Research on dual-arm parallel coal gangue sorting robot and its trajectory planning[J]. Industry and Mine Automation,2020,46(9):57-63.
[31]	夏晶,张昊,周世宁,等. 煤矸分拣机器人动态拣取避障路径规划[J]. 煤炭学报,2021,46(增刊1):570-577. XIA Jing,ZHANG Hao,ZHOU Shining,et al. Dynamic picking and obstacle avoidance path planning of coal gangue sorting robot[J]. Journal of China Coal Society,2021,46(S1):570-577.
[32]	朱子祺,李创业,代伟. 基于G−RRT^算法的煤矸石分拣机器人路径规划[J]. 工矿自动化,2022,48(3):55-62. ZHU Ziqi,LI Chuangye,DAI Wei. Path planning of coal gangue sorting robot based on G-RRT^ algorithm[J]. Journal of Mine Automation,2022,48(3):55-62.
[33]	谢龙,刘山. 基于改进势场法的机械臂动态避障规划[J]. 控制理论与应用,2018,35(9):1239-1249. doi: 10.7641/CTA.2018.70187 XIE Long,LIU Shan. Dynamic obstacle-avoiding motion planning for manipulator based on improved artificial potential filed[J]. Control Theory & Applications,2018,35(9):1239-1249. doi: 10.7641/CTA.2018.70187
[34]	邹宇星,李立君,高自成. 基于改进PRM的采摘机器人机械臂避障路径规划[J]. 传感器与微系统,2019,38(1):52-56. ZOU Yuxing,LI Lijun,GAO Zicheng. Obstacle avoidance path planning for harvesting robot arm based on improved PRM[J]. Transducer and Microsystem Technologies,2019,38(1):52-56.
[35]	陈秋莲,蒋环宇,郑以君. 机器人路径规划的快速扩展随机树算法综述[J]. 计算机工程与应用,2019,55(16):10-17. doi: 10.3778/j.issn.1002-8331.1905-0061 CHEN Qiulian,JIANG Huanyu,ZHENG Yijun. Summary of rapidly-exploring random tree algorithm in robot path planning[J]. Computer Engineering and Applications,2019,55(16):10-17. doi: 10.3778/j.issn.1002-8331.1905-0061
[36]	葛吉民,邓朝晖,李尉,等. 机器人磨抛力柔顺控制研究进展[J]. 中国机械工程,2021,32(18):2217-2230,2238. doi: 10.3969/j.issn.1004-132X.2021.18.011 GE Jimin,DENG Zhaohui,LI Wei,et al. Research progresses of robot grinding and polishing force compliance controls[J]. China Mechanical Engineering,2021,32(18):2217-2230,2238. doi: 10.3969/j.issn.1004-132X.2021.18.011