XU Zhi, LI Jingzhao, ZHANG Chuanjiang, YAO Lei, WANG Jiwei. Lightweight CNN and its application in coal mine intelligent video surveillance[J]. Journal of Mine Automation, 2020, 46(12): 13-19. DOI: 10.13272/j.issn.1671-251x.17674
Citation: XU Zhi, LI Jingzhao, ZHANG Chuanjiang, YAO Lei, WANG Jiwei. Lightweight CNN and its application in coal mine intelligent video surveillance[J]. Journal of Mine Automation, 2020, 46(12): 13-19. DOI: 10.13272/j.issn.1671-251x.17674

Lightweight CNN and its application in coal mine intelligent video surveillance

More Information
  • The massive amount of surveillance video in coal mines is transmitted to the cloud computing center for centralized processing through Ethernet. This method has problems such as high latency, high cost and high network bandwidth occupation. To address the above problems, a lightweight convolutional neural network (CNN) model is constructed with depthwise separable convolution as the core. Moreover, the lightweight CNN model is optimized by introducing the residual structure to improve the image feature extraction ability. The low contrast of surveillance video images caused by the complex lighting environment in coal mines affects the recognition accuracy of the model. Hence, the contrast limited adaptive histogram equalization (CLAHE) algorithm is used to improve the brightness and contrast of images so as to improve the recognition effect of the model. The lightweight CNN model is compressed by STM32Cube AI and deployed on the embedded platform. A video surveillance terminal based on the lightweight CNN model is designed to perform real-time and intelligent processing of coal mine surveillance video locally to achieve real-time identification and alarming of coal mine violations. Experimental results show that by introducing the residual structure to optimize the lightweight CNN model and using the CLAHE algorithm for image enhancement, the model can achieve an accuracy of more than 95% for recognizing various violations in coal mines and improve real-time response to violations.
  • Related Articles

    [1]CUI Jing, LUAN Baowei, REN Laihong, LU Zhenguo, YANG Yanchao. Design of embedded collaborative simulation platform for complex equipment on fully-mechanized coal mining face[J]. Journal of Mine Automation, 2017, 43(1): 48-52. DOI: 10.13272/j.issn.1671-251x.2017.01.012
    [2]LIU Xiaowen, CHEN Chunxu, ZHANG Jing, ZHANG Lei, HU Yanjun, ZHOU Xing. Research of circle buffer of embedded soft PLC system based on CAN network[J]. Journal of Mine Automation, 2015, 41(4): 94-98. DOI: 10.13272/j.issn.1671-251x.2015.04.024
    [3]ZHENG Chuanxing. Design of embedded hardware platform of mine dynamic light-rail weighter system[J]. Journal of Mine Automation, 2014, 40(10): 4-7. DOI: 10.13272/j.issn.1671-251x.2014.10.002
    [4]DU Yan, MENG Guoying, ZHANG Hanwen, ZHANG Miaotian, FENG Yu. Design of embedded monitoring and control platform of conveyor equipment of fully mechanized coal face of coal mine[J]. Journal of Mine Automation, 2014, 40(7): 96-98. DOI: 10.13272/j.issn.1671-251x.2014.07.026
    [5]FENG Xuejun, LIU Shoubao, YANG Hai, WANG Qu. A monitoring and fault diagnosis system for shearer based on embedded platform[J]. Journal of Mine Automation, 2014, 40(3): 90-94. DOI: 10.13272/j.issn.1671-251x.2014.03.024
    [6]YAN Kui. Design of Embedded PLC System and Its Implementatio[J]. Journal of Mine Automation, 2012, 38(7): 112-115.
    [7]YUAN Xiao-ming. Design of Mine-used LCD Display Platform Based on Embedded System[J]. Journal of Mine Automation, 2011, 37(8): 119-121.
    [8]GAO Yong-qing, SHANG Dan. Design of Embedded VoIP Terminal Based on Intel IXP425[J]. Journal of Mine Automation, 2009, 35(6): 116-119.
    [9]SUN Wei-bing, REN Zi-hui, WEI Tong-yu, DU Yun-zhe. Design of Embedded PLC Based on RPN Algorithm[J]. Journal of Mine Automation, 2009, 35(6): 113-116.
    [10]LI Na, ZHAO Bing, ZHAI Wen-ya. Design of Embedded FOM Network Management SNMP Agent and Its Implementatio[J]. Journal of Mine Automation, 2008, 34(1): 44-47.
  • Cited by

    Periodical cited type(9)

    1. 常琳, 李宗伟. 煤矿工业视频监控系统通用技术条件标准研究制定. 工矿自动化. 2025(05) 本站查看
    2. 常张薇. 基于卷积神经网络的安防监控软件目标检测策略改进. 软件. 2025(05)
    3. 陈志文,陈嫒靓霏,唐晓丹,柯浩彬,蒋朝辉,肖菲. 面向煤矿安全监测边缘计算的YOLOv5s剪枝方法. 工矿自动化. 2024(07): 89-97 . 本站查看
    4. 岳刘杰,齐庆杰,关芳明,武智,马少君,史洪恺. 综采工作面5G智能化控制系统改造设计. 煤炭技术. 2023(04): 178-182 .
    5. 杨志方. 基于雷达与视觉融合的双模态煤矿井下环境感知技术. 工矿自动化. 2023(11): 67-75 . 本站查看
    6. 王晓光,梁皓越,赵忠山,张海涛,邵梓洋,刘光伟. 露天矿山违章行为智能视频系统研究. 采矿技术. 2022(04): 225-229 .
    7. 梁占泽,马平,赵俊达,王铮,刘涛. 煤矿井下智能无轨辅助运输技术研究. 煤炭工程. 2022(S1): 6-11 .
    8. 刘孝军,王飞. 基于AI的煤矿视频智能分析技术. 煤炭科学技术. 2022(S2): 260-264 .
    9. 刘仲博. 基于卷积神经网络的电选粉煤灰颗粒图像识别与烧失量预测模型. 中国矿业. 2021(05): 125-129 .

    Other cited types(9)

Catalog

    WANG Jiwei

    1. On this Site
    2. On Google Scholar
    3. On PubMed

    Article Metrics

    Article views (133) PDF downloads (29) Cited by(18)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return