Volume 50 Issue 3
Mar.  2024
Turn off MathJax
Article Contents
CAO Shuai, DONG Lihong, DENG Fan, et al. A small object detection method for coal mine underground scene based on YOLOv7-SE[J]. Journal of Mine Automation,2024,50(3):35-41.  doi: 10.13272/j.issn.1671-251x.2023090088
Citation: CAO Shuai, DONG Lihong, DENG Fan, et al. A small object detection method for coal mine underground scene based on YOLOv7-SE[J]. Journal of Mine Automation,2024,50(3):35-41.  doi: 10.13272/j.issn.1671-251x.2023090088

A small object detection method for coal mine underground scene based on YOLOv7-SE

doi: 10.13272/j.issn.1671-251x.2023090088
  • Received Date: 2023-09-27
  • Rev Recd Date: 2024-03-13
  • Available Online: 2024-03-26
  • Although current small object detection methods have improved the detection performance, they are mostly objected at conventional scenarios. In harsh underground environments in coal mines, there are difficulties in extracting small object feature information during the underground small object detection process. In order to solve the problem. a small object detection method for coal mine underground scenes based on YOLOv7-SE has been proposed. Firstly, the simulated annealing (SA) algorithm is integrated with the k-means++clustering algorithm to accurately capture small underground objects by optimizing the estimation of initial anchor box values in the YOLOv7 model. Secondly, a new detection layer is added to the YOLOv7 backbone network to obtain high-resolution feature maps of underground small objects, reducing the interference of a large amount of coal dust on the feature representation of underground small objects. Finally, a dual layer attention mechanism is introduced after the aggregation network module in the backbone network to enhance the feature representation of small underground objects. The experimental results show the following points. ① The loss function of the YOLOv7-SE network model after training is stable around 0.05, indicating that the parameter settings of the YOLOv7-SE network model are reasonable. ② The average precision (AP) of helmet detection based on the YOLOv7-SE network model has improved by 13.86%, 25.3%, 16.13%, 12.71%, 15.53%, 11.59% and 12.20% compared to Faster R-CNN, RetinaNet, CenterNet, FCOS, SSD, YOLOv5 and YOLOv7, respectively. The self rescue device detection AP based on the YOLOv7-SE network model has improved by 12.37%, 20.16%, 15.22%, 8.35%, 19.42%, 9.64% and 7.38% compared to Faster R-CNN, RetinaNet, CenterNet, FCOS, SSD, YOLOv5 and YOLOv7, respectively.The frames per second (FPS) of the YOLOv7-SE network model has increased by 42.56, 44.43, 31.74, 39.84, 22.74 and 23.34 frames/s compared to Faster R-CNN, RetinaNe, CenterNet, FCOS, SSD and YOLOv5, respectively, and decreased by 9.36 frames/s compared to YOLOv7. The YOLOv7-SE network model effectively enhances the feature extraction capability of the YOLOv7-SE network model for small underground objects while ensuring detection speed. ③ In the detection of safety helmets and self rescue devices, the YOLOv7-SE network model effectively improves missed and false detection, and improves detection precision.

     

  • loading
  • [1]
    许鹏飞. 2000−2021年我国煤矿事故特征及发生规律研究[J]. 煤炭工程,2022,54(7):129-133.

    XU Pengfei. Characteristics and occurrence regularity of coal mine accidents in China from 2020 to 2021[J]. Coal Engineering,2022,54(7):129-133.
    [2]
    LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91_110.
    [3]
    DALAL N,TRIGGS B. Histograms of oriented gradients for human detection[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,San Diego,2005. DOI: 10.1109/CVPR.2005.177.
    [4]
    PLATT J. Sequential minimal optimization:a fast algorithm for training support vector machines[EB/OL]. (1998-04-21) [2023-07-05]. https://api.semanticscholar.org/CorpusID:577580.
    [5]
    杨锋,丁之桐,邢蒙蒙,等. 深度学习的目标检测算法改进综述[J]. 计算机工程与应用,2023,59(11):1_15.

    YANG Feng,DING Zhitong,XING Mengmeng,et al. Review of object detection algorithm improvement in deep learning[J]. Computer Engineering and Applications,2023,59(11):1_15.
    [6]
    GIRSHICK R,DONAHUE J,DARRELL T,et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]. IEEE Conference on Computer Vision and Pattern Recognition,Columbus,2014:580_587.
    [7]
    GIRSHICK R. Fast R-CNN[C]. IEEE International Conference on Computer Vision,Santiago,2015:1440_1448.
    [8]
    REN Shaoqing,HE Kaiming,GIRSHICK R,et al. Faster R-CNN:towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
    [9]
    LIU Wei,ANGUELOV D,ERHAN D,et al. SSD:single shot multiBox detector[C]. The14th European Conference on Computer Vision,Amsterdam,2016:21_37.
    [10]
    REDMON J,DIVVALA S,GIRSHICK R,et al. You only look once:unified,real-time object detection[C]. IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,2016:779_788.
    [11]
    REDMON J,FARHADI A. YOLO9000:better,faster,stronger[C]. IEEE Conference on Computer Vision and Pattern Recognition,Honolulu,2017:7263_7271.
    [12]
    REDMON J,FARHADI A. YOLOv3:an incremental improvement[EB/OL]. (2018-04-08) [2023-07-05]. https://arxiv.org/abs/1804.02767.
    [13]
    BOCHKOVSKIY A,WANG C Y,LIAO H. YOLOv4:optimal speed and accuracy of object detection[EB/OL]. (2020-04-23) [2023-07-05]. https://arxiv.org/abs/2004.10934.
    [14]
    GE Z,LIU S,WANG F,et al. YOLOX:exceeding yolo series in 2021[EB/OL]. (2021-07-18) [2023-07-05]. https://arxiv.org/abs/2107.08430.
    [15]
    SUN Wei,DAI Liang,ZHANG Xiaorui,et al. RSOD:real-time small object detection algorithm in uav-based traffic monitoring[J]. Applied Intelligence,2022,52(8). DOI: 10.1007/S10489-021-02893-3.
    [16]
    翟国栋,任聪,王帅,等. 多尺度特征融合的煤矿救援机器人目标检测模型[J]. 工矿自动化,2020,46(11):54_58.

    ZHAI Guodong,REN Cong,WANG Shuai,et al. Object detection model of coal mine rescue robot based on multi-scale feature fusion[J]. Industry and Mine Automation,2020,46(11):54_58.
    [17]
    沈科,季亮,张袁浩,等. 基于改进YOLOv5s模型的煤矸目标检测[J]. 工矿自动化,2021,47(11):107_111,118.

    SHEN Ke,JI Liang,ZHANG Yuanhao,et al. Research on coal and gangue detection algorithm based on improved YOLOv5s model[J]. Industry and Mine Automation,2021,47(11):107_111,118.
    [18]
    ZHANG Dawei,ZHENG Zhonglong,LI Minglu,et al. CSART:channel and spatial attention-guided residual learning for real-time object tracking[J]. Neurocomputing,2021,436(14):260_272.
    [19]
    ZHANG Dawei,ZHENG Zhonglong,WANG Tianxiang,et al. HROM:learning high-resolution representation and object-aware masks for visual object tracking[J]. Sensors,2020,20(17). DOI: 10.3390/s20174807.
    [20]
    ZHU Lei,WANG Xinjiang,KE Zhanghan,et al. BiFormer:vision transformer with bi-level routing attention[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Vancouver,2023:10323_10333.
    [21]
    WANG Chenyao,BOCHKOVSKIY A,LIAO H. YOLOv7:trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]. IEEE/CVF Conference on Computer Vision and Pattern Recognition,Vancouver,2023:7464_7475.
    [22]
    曹鹏. 基于模拟退火算法的大螺旋钻机自主钻进控制系统研究[J]. 煤矿机械,2023,44(10):194_196.

    CAO Peng. Research on autonomous drilling control system of large screw drilling rig based on simulated annealing algorithm[J]. Coal Mine Machinery,2023,44(10):194_196.
    [23]
    HE Kaiming,SUN Jian,TANG Xiao'ou. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2011,33(12):2341_2353.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)  / Tables(3)

    Article Metrics

    Article views (125) PDF downloads(26) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return