Volume 48 Issue 2
Feb.  2022
Turn off MathJax
Article Contents
Abstract
References
Related Articles
QIN Peilin, ZHANG Chuanwei, ZHOU Libing, WANG Jianlong. Research on 3D target detection of unmanned trackless rubber-tyred vehicle in coal mine[J]. Journal of Mine Automation, 2022, 48(2): 35-41. DOI: 10.13272/j.issn.1671-251x.2021110068
Citation: QIN Peilin, ZHANG Chuanwei, ZHOU Libing, WANG Jianlong. Research on 3D target detection of unmanned trackless rubber-tyred vehicle in coal mine[J]. Journal of Mine Automation, 2022, 48(2): 35-41. DOI: 10.13272/j.issn.1671-251x.2021110068
shu

Research on 3D target detection of unmanned trackless rubber-tyred vehicle in coal mine

  • 1.

    College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China;

  • 2.

    CCTEG Changzhou Research Institute, Changzhou 213015, China;

  • 3. Tiandi(Changzhou) Automation Co., Ltd., Changzhou 213015, China

More Information
  • Received Date: November 28, 2021
  • Revised Date: February 12, 2022
  • Available Online: February 28, 2022
    Graphical Abstract
    • Abstract
  • The environment perception based on 3D detection is the basis of unmanned driving technology of trackless rubber-tyred vehicle in coal mine. Due to the lack of light in the underground environment, the RGB image information is missing, and the narrow roadway space leads to more noise in the point cloud data collected by laser radar, so the existing 3D target detection methods based on image or radar point cloud can not achieve good detection effect in the underground. In order to solve this problem, a 3D target detection method for unmanned trackless rubber-tyred vehicle is proposed, which fuses image and radar point cloud. The obtained driving environment data of the trackless rubber-tyred vehicle is preprocessed. The global histogram equalization method is used to improve the brightness of RGB images and reduce the effect of uneven lighting in coal mine. The bilateral filtering and denoising and principal component analysis dimensionality reduction processing are performed on radar point cloud data to improve the quality of point cloud data and reduce computing time. A fusion image and radar point cloud detection model is designed. The region proposal network is used to generate 2D image candidate regions, which are fused with the point cloud data at the early characteristic level to generate 3D candidate regions, and then fused with the pooled image and point cloud data at the later region level to output the 3D detection anchor frame to realize target detection. The experimental results show that compared with the detection methods based on YOLO3D and MV3D models, the proposed method has higher detection precision of the target to be tested, and achieves a better balance between precision and detection speed. The underground test results show that the method can accurately detect the position of pedestrians or vehicles in the driving environment of trackless rubber-tyred vehicle, and has good underground adaptability.
    • FullText(HTML)
    • References (15)
  • [1]
    王陈,鲍久圣,袁晓明,等.无轨胶轮车井下无人驾驶系统设计及控制策略研究[J].煤炭学报,2021,46(增刊1):520-528.

    WANG Chen,BAO Jiusheng,YUAN Xiaoming,et al.Design and control strategy of underground driverless system for trackless rubber tire vehicle[J].Journal of China Coal Society,2021,46(S1):520-528.
    [2]
    ALI W,ABDELKARIM S,ZAHRAN M,et al.YOLO3D:end-to-end real-time 3D oriented object bounding box detection from LiDAR point cloud[C]//Proceedings of the European Conference on Computer Vision,Munich,2018:10-30.
    [3]
    MOUSAVIAN A,ANGUELOV D,FLYNN J,et al.3D bounding box estimation using deep learning and geometry[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,Honolulu,2017:7074-7082.
    [4]
    CHABOT F,CHAOUCH M,RABARISOA J,et al.Deep MANTA:a coarse-to-fine many-task network for joint 2D and 3D vehicle analysis from monocular image[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,Hawaii,2017:2040-2049.
    [5]
    CHEN Xiaozhi,KUNDU K,ZHU Yukun,et al.3D object proposals using stereo imagery for accurate object class detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,40(5):1259-1272.
    [6]
    LI Bo,ZHANG Tianlei,XIA Tian.Vehicle detection from 3D lidar using fully convolutional network[Z/OL].arXiv Preprint,arXiv:1608.07916. https://arxiv.org/abs/1608.07916v1.
    [7]
    KU J,MOZIFIAN M,LEE J,et al.Joint 3D proposal generation and object detection from view aggregation[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems,Madrid,2018:1-8.
    [8]
    CHEN Xiaozhi,MA Huimin,WAN Ji,et al.Multi-view 3D object detection network for autonomous driving[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hawaii,2017:1907-1915.
    [9]
    QI C R,LIU Wei,WU Chenxia,et al.Frustum PointNets for 3D object detection from RGB-D data[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,Salt Lake City,2018:918-927.
    [10]
    闫凌,黄佳德.矿用卡车无人驾驶系统研究[J].工矿自动化,2021,47(4):19-29.

    YAN Ling,HUANG Jiade.Research on unmanned driving system of mine-used truck[J].Industry and Mine Automation,2021,47(4):19-29.
    [11]
    贾祝广,孙效玉,王斌,等.无人驾驶技术研究及展望[J].矿业装备,2014(5):44-47.

    JIA Zhuguang,SUN Xiaoyu,WANG Bin,et al.Research and prospect of unmanned driving technology[J].Mining Equipment,2014(5):44-47.
    [12]
    路皓翔,刘振丙,郭棚跃,等.多尺度卷积结合自适应双区间均衡化的图像增强[J].光子学报,2020,49(10):158-172.

    LU Haoxiang,LIU Zhenbing,GUO Pengyue,et al.Multi-scale convolution combined with adaptive Bi-interval equalization for image enhancement[J].Acta Photonica Sinica,2020,49(10):158-172.
    [13]
    呼亚萍,孔韦韦,黄翠玲,等.一种基于卷积运算与全变分模型的图像去噪方法[J].电讯技术,2020,60(10):1194-1199.

    HU Yaping,KONG Weiwei,HUANG Cuiling,et al.An image denoising method based on convolution operation and full variational model[J].Telecommunication Engineering,2020,60(10):1194-1199.
    [14]
    REN Shaoqing,HE Kaiming,GIRSHICK R,et al.Faster R-CNN:towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
    [15]
    LIU Wei,ANGUELOV D,ERHAN D,et al.SSD:single shot multibox detector[C]//European Conference on Computer Vision,Amsterdam,2016:21-40.
    • Related Articles

  • Related Articles

    [1]Study on the correlation between seismic characteristics and mine rock burst in Hegang area[J]. Journal of Mine Automation.
    [2]WU Wenzhen, CHENG Jiming, LI Biao. Audio fault diagnosis method of mine belt conveyor roller[J]. Journal of Mine Automation, 2022, 48(9): 25-32. DOI: 10.13272/j.issn.1671-251x.2022070071
    [3]LYU Yuanbo, WANG Shibo, GE Shirong, ZHOU Yue, WANG Saiya, BAI Yongtai. Development of coal and rock identification device based on near-infrared spectroscopy[J]. Journal of Mine Automation, 2022, 48(7): 32-42. DOI: 10.13272/j.issn.1671-251x.17953
    [4]CHENG Weiwei, WU Rui. Predictive control of high-power three-level PWM rectifier without weighting coefficient[J]. Journal of Mine Automation, 2021, 47(1): 81-86. DOI: 10.13272/j.issn.1671-251x.2020070015
    [5]JU Chen, ZHANG Chao, FAN Hongwei, ZHANG Xuhui, YANG Yiqing, YAN Yang. Rolling bearing fault diagnosis based on wavelet packet decomposition and PSO-BPN[J]. Journal of Mine Automation, 2020, 46(8): 70-74. DOI: 10.13272/j.issn.1671-251x.2019120022
    [6]WANG Jianxin, CHENG Junhao. Research on relationship between tailing slurry concentration and ultrasonic attenuation coefficient[J]. Journal of Mine Automation, 2020, 46(2): 45-49. DOI: 10.13272/j.issn.1671-251x.2019050038
    [7]GAO Caixia, WU Tong, FU Ziyi. Denoising method of vibration signal of rolling bearing based on multi—criteria fusio[J]. Journal of Mine Automation, 2018, 44(11): 100-104. DOI: 10.13272/j.issn.1671—251x.2018050071
    [8]SUN Jiping, CHEN Bang. A coal-rock recognition method based on statistical modeling ofsteerable pyramidal decomposition coefficients[J]. Journal of Mine Automation, 2016, 42(12): 1-5. DOI: 10.13272/j.issn.1671-251x.2016.12.001
    [9]YANG Jianjian, LI Xu, FU Shichen, WU Miao. Research on correction coefficient of relationship formula of shearer parameters and coal rock hardness[J]. Journal of Mine Automation, 2015, 41(8): 123-126. DOI: 10.13272/j.issn.1671-251x.2015.08.031
    [10]LI Wen-tao, LIANG Hao. Design of Real-time Cross Correlator Based on NIOSⅡ[J]. Journal of Mine Automation, 2009, 35(5): 112-115.

  • Cited by

    Periodical cited type(1)

    1. 李萍. ZigBee策略下的矿井远程应急通信系统设计. 煤炭技术. 2018(07): 257-259 .

    Other cited types(2)

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (1640) PDF downloads (91) Cited by(3)
    Related

    苏ICP备 05016349号-2

    Supported by: Beijing Renhe Information Technology Co., Ltd. Visits：1225222    Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return