Volume 48 Issue 4
Apr.  2022
Turn off MathJax
Article Contents
ZHANG Yixiang, LIN Song, LI Xue. Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet[J]. Journal of Mine Automation,2022,48(4):66-71.  doi: 10.13272/j.issn.1671-251x.2021080058
Citation: ZHANG Yixiang, LIN Song, LI Xue. Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet[J]. Journal of Mine Automation,2022,48(4):66-71.  doi: 10.13272/j.issn.1671-251x.2021080058

Personnel detection in dangerous area of coal preparation plant based on CenterNet-GhostNet

doi: 10.13272/j.issn.1671-251x.2021080058
  • Received Date: 2021-08-21
  • Rev Recd Date: 2022-04-02
  • Available Online: 2022-03-05
  • Due to the dust and fog interference, it is difficult to distinguish accurately the whole body target of personnel in dangerous areas of coal preparation plant from the production environment background. Moreover, the head features of personnel are relatively easy to be identified, and the possibility of head being blocked in the monitoring perspective is low. Therefore, the head detection of personnel in dangerous areas is used instead of the whole body target detection of personnel. At present, the lightweight target detection model based on deep learning has a lot of information loss in feature extraction, and its detection capability of human head target is limited. In order to solve this problem, a lightweight personnel detection model CenterNet-GhostNet is proposed. The model takes CenterNet network as the basic framework, and combines the lightweight network GhostNet and the feature pyramid network(FPN) as the feature extraction network. GhostNet extracts the features of the input image and improves the network feature expression capability. And the FPN fuses the information contained in the feature maps with different resolutions extracted by GhostNet, so that more detailed information is reserved while extracting the high-level semantic features. Three independent convolution operation branches are used to decode and calculate the single output feature map with higher resolution, so as to make full use of the detailed information contained in the feature map. The experimental results show that the detection precision of CenterNet-GhostNet model is 93.7% and 91.7% respectively for the two types of head targets with and without helmet, which are better than the general lightweight models SSD-MobileNet, YOLOv4 Tiny and CenterNet-Res18. The single frame detection time of CenterNet-GhostNet model deployed on NVIDIA Jetson Nano is 67 ms, which meets the requirements of high-precision and real-time detection of personnel in dangerous areas of coal preparation plant.

     

  • loading
  • [1]
    张宗华. 选煤厂人员智能视频监控系统设计[J]. 工矿自动化,2013,39(4):76-79. doi: 10.7526/j.issn.1671-251X.2013.04.020

    ZHANG Zonghua. Design of intelligent video monitoring system of personnel of coal preparation plant[J]. Industry and Mine Automation,2013,39(4):76-79. doi: 10.7526/j.issn.1671-251X.2013.04.020
    [2]
    张圣强,王建军,丁蕾. 选煤厂智能视频监控中的运动人体目标检测方法[J]. 工矿自动化,2011,37(11):60-62.

    ZHANG Shengqiang,WANG Jianjun,DING Lei. Detecting method of moving human in intelligent video monitoring of coal preparation plant[J]. Industry and Mine Automation,2011,37(11):60-62.
    [3]
    陈海龙. 煤矿选煤厂巡检机器人的研究与设计[D]. 徐州: 中国矿业大学, 2014.

    CHEN Hailong. The study and design of coal cleaning plant inspection robot[D]. Xuzhou: China University of Mining and Technology, 2014.
    [4]
    林娅静. 基于视觉的选煤厂智能监控系统研究[D]. 徐州: 中国矿业大学, 2014.

    LIN Yajing. Research on intelligent monitoring system of coal preparation plant based on vision[D]. Xuzhou: China University of Mining and Technology, 2014.
    [5]
    周晨晖. 基于深度学习的煤矿复杂场景人员检测与统计分析方法研究[D]. 徐州: 中国矿业大学, 2019.

    ZHOU Chenhui. Research on personnel detection and statistical analysis in coal mine complex scenes based on deep learning[D]. Xuzhou: China University of Mining and Technology, 2019.
    [6]
    ZHOU Xingyi, WANG Dequan, KRAHENBUHL P. Objects as points[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, 2019: 7263-7271.
    [7]
    HAN K, WANG Yunhe, TIAN Qi, et al. GhostNet: more features from cheap operations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, 2016: 1577-1586.
    [8]
    LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 2017: 2117-2125.
    [9]
    HOWARD A G, ZHU Menglong, CHEN Bo, et al. MobileNets: efficient convolutional neural networks for mobile vision applications[EB/OL]. [2021-08-02]. https://arxiv.org/abs/1704.04861.
    [10]
    DAI Jifeng, QI Haozhi, XIONG Yuwen, et al. Deformable convolutional networks[C]//IEEE International Conference on Computer Vision, Venice, 2017: 764-773.
    [11]
    XU Yuanyuan,YAN Wan,YANG Genke,et al. CenterFace:joint face detection and alignment using face as point[J]. Scientific Programming,2020,2020:1-8.
    [12]
    LIN T Y,GOYAL P,GIRSHICK R,et al. Focal loss for dense object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(2):318-327. doi: 10.1109/TPAMI.2018.2858826
    [13]
    BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. [2021-08-02]. https://arxiv.org/abs/2004.10934.
    [14]
    EVERINGHAM M,GOOL L V,WILLIAMS C K I,et al. The PASCAL visual object classes( VOC) challenge[J]. International Journal of Computer Vision,2010,88(2):303-338. doi: 10.1007/s11263-009-0275-4
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)  / Tables(2)

    Article Metrics

    Article views (228) PDF downloads(53) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return