Volume 48 Issue 10
Oct.  2022
Turn off MathJax
Article Contents
ZHANG Dong, JIANG Yuanyuan. Drill pipe counting method based on improved MobileNetV2[J]. Journal of Mine Automation,2022,48(10):69-75.  doi: 10.13272/j.issn.1671-251x.2022060019
Citation: ZHANG Dong, JIANG Yuanyuan. Drill pipe counting method based on improved MobileNetV2[J]. Journal of Mine Automation,2022,48(10):69-75.  doi: 10.13272/j.issn.1671-251x.2022060019

Drill pipe counting method based on improved MobileNetV2

doi: 10.13272/j.issn.1671-251x.2022060019
  • Received Date: 2022-06-07
  • Rev Recd Date: 2022-10-07
  • Available Online: 2022-09-19
  • The existing drill pipe counting methods based on manual and instrument have the problems of low precision, time-consuming and labor-consuming. The existing drill pipe counting methods based on image processing are difficult to extract image features, the network model has high complexity and large amount of computation. In order to solve the above problems, a drill pipe counting method based on improved MobileNetV2 is proposed. The working state image of the drilling rig is collected through a camera. The collected image is preprocessed by adopting data enhancement. On the basis of MobileNetV2, the convolutional block attention module is added to enhance the thinning capability of features. The objective function is optimized to improve the recognition precision. The initial parameters are obtained through transfer learning. The improved MobileNetV2 is used as the working state recognition model of the drilling rig. The working state features of the drilling rig are extracted by the model. The confidence data are generated by recognizing the four working states of the drilling rig, including drill pipe installation, drill pipe driving, drill pipe unloading and shut down during the whole drilling process of the drill pipe. The confidence data are filtered through a sliding window. The number of drill pipes is accurately counted, and the drilling depth is determined. The experimental results show that the recognition accuracy of the improved MobileNetV2 model reaches 99.95%. Compared with the classical classification models ResNet50, Xception, InceptionV3, InceptionResNetV2 and MobileNetV2, the accuracy is improved by 1.35%, 1.28%, 1.43%, 0.85% and 1.25% respectively. The parameter is reduced by 38.9% compared with the MobileNetV2 model. The convergence speed of the model is faster and the comprehensive performance is better. The drill pipe counting method based on the improved MobileNetV2 is applied to the drill pipe counting of fully mechanized mining face of a coal mine. The average drill pipe statistical precision is 98.4%. The accurate counting of the drill pipes is realized. The feasibility and practicability of application of the method in the complex environment are verified.

     

  • loading
  • [1]
    郑仰峰,翟成,辛海会,等. 煤巷掘进工作面强弱耦合能量控制防治煤与瓦斯突出理论与方法[J]. 采矿与安全工程学报,2021,38(6):1269-1280.

    ZHENG Yangfeng,ZHAI Cheng,XIN Haihui,et al. Theories and methods of coal and gas outburst prevention by strong-weak coupling energy control in coal roadway driving face[J]. Journal of Mining & Safety Engineering,2021,38(6):1269-1280.
    [2]
    孙志飞,吴银成,胡云. 钻杆长度测量方法[J]. 工矿自动化,2015,41(3):51-53.

    SUN Zhifei,WU Yincheng,HU Yun. Length measurement methods of drill pipe[J]. Industry and Mine Automation,2015,41(3):51-53.
    [3]
    胡少兵,罗明璋,程峰,等. 基于应力波频谱图的护栏金属立柱埋深检测法[J]. 公路,2022,67(6):336-341.

    HU Shaobing,LUO Mingzhang,CHENG Feng,et al. Method of detecting the buried depth of guardrail metal column based on stress wave spectrum image[J]. Highway,2022,67(6):336-341.
    [4]
    徐钊,房咪咪,周红伟,等. 基于电驻波的锚杆长度无损测量方法[J]. 工矿自动化,2013,39(9):112-115.

    XU Zhao,FANG Mimi,ZHOU Hongwei,et al. Non-destructive measurement method of anchor stock length based on electricity standing wave[J]. Industry and Mine Automation,2013,39(9):112-115.
    [5]
    李宏达,黄鼎琨,张彬,等. 改进的低压脉冲法对变压器绕组变形的探测研究[J]. 南京理工大学学报,2020,44(1):15-20.

    LI Hongda,HUANG Dingkun,ZHANG Bin,et al. Research in detection of winding transformer variation based on improved LVI method[J]. Journal of Nanjing University of Science and Technology,2020,44(1):15-20.
    [6]
    徐志强,吕子奇,王卫东,等. 煤矸智能分选的机器视觉识别方法与优化[J]. 煤炭学报,2020,45(6):2207-2216.

    XU Zhiqiang,LYU Ziqi,WANG Weidong,et al. Machine vision recognition method and optimization for intelligent separation of coal and gangue[J]. Journal of China Coal Society,2020,45(6):2207-2216.
    [7]
    董立红,彭业勋,符立梅. 基于Sobel边缘检测的圆周Harris角点检测算法[J]. 西安科技大学学报,2019,39(2):374-380.

    DONG Lihong,PENG Yexun,FU Limei. Circular Harris corner detection algorithm based on Sobel edge detection[J]. Journal of Xi'an University of Science and Technology,2019,39(2):374-380.
    [8]
    董立红,王杰,厍向阳. 基于改进Camshift算法的钻杆计数方法[J]. 工矿自动化,2015,41(1):71-76. doi: 10.13272/j.issn.1671-251x.2015.01.018

    DONG Lihong,WANG Jie,SHE Xiangyang. Drill counting method based on improved Camshift algorithm[J]. Industry and Mine Automation,2015,41(1):71-76. doi: 10.13272/j.issn.1671-251x.2015.01.018
    [9]
    高瑞,郝乐,刘宝,等. 基于改进ResNet网络的井下钻杆计数方法[J]. 工矿自动化,2020,46(10):32-37.

    GAO Rui,HAO Le,LIU Bao,et al. Research on underground drill pipe counting method based on improved ResNet network[J]. Industry and Mine Automation,2020,46(10):32-37.
    [10]
    党伟超,姚远,白尚旺,等. 煤矿探水卸杆动作识别研究[J]. 工矿自动化,2020,46(7):107-112.

    DANG Weichao,YAO Yuan,BAI Shangwang,et al. Research on unloading drill-rod action identification in coal mine water exploration[J]. Industry and Mine Automation,2020,46(7):107-112.
    [11]
    SANDLER M, HOWARD A, ZHU M, et al. MobileNetV2: inverted residuals and linear bottlenecks[EB/OL]. [2022-05-16]. http://arxiv.org/pdf/1801.04381.pdf.
    [12]
    WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]. European Conference on Computer Vision, Munich, 2018: 3-19.
    [13]
    朱劲松,李欢,王世芳. 基于卷积神经网络和迁移学习的钢桥病害识别[J]. 长安大学学报(自然科学版),2021,41(3):52-63.

    ZHU Jinsong,LI Huan,WANG Shifang. Defect recognition for steel bridge based on convolutional neural network and transfer learning[J]. Journal of Chang'an University(Natural Science Edition),2021,41(3):52-63.
    [14]
    LIN T Y,GOYAL P,GIRSHICK R,et al. Focal loss for dense object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(2):318-327.
    [15]
    HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Deep residual learning for image recognition[C]. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 2016: 770-778.
    [16]
    CHOLLET F. Xception: deep learning with depthwise separable convolutions [C]. IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, 2017: 1251-1258.
    [17]
    SZEGEDY C, VANHOUCKE V, IOFFE S, et al. Rethinking the inception architecture for computer vision[C]. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 2016: 2818-2826.
    [18]
    SZEGEDY C, IOFFE S, VANHOUCKE V, et al. Inception-v4: Inception-ResNet and the impact of residual connections on learning [C]. The 31st AAAI Conference on Artificial Intelligence, Palo Alto, 2017: 4278-4284.
    [19]
    方杰,李振璧,夏亮. 基于ECO−HC的钻杆计数方法[J]. 煤炭技术,2021,40(11):186-189.

    FANG Jie,LI Zhenbi,XIA Liang. Drill pipe counting method based on ECO-HC[J]. Coal Technology,2021,40(11):186-189.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)  / Tables(3)

    Article Metrics

    Article views (191) PDF downloads(39) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return