摘要
针对困难气道气管插管过程中内窥镜图像视角较小、目标尺度变化大、相互遮挡等问题,融合内窥镜图像和CO2浓度信息,提出基于深度学习的多模态气管插管智能目标检测算法。首先,对传统的YOLOv3网络进行改进,利用不同扩张率的空洞卷积构建并行多分支空洞卷积模块,并对输出特征进行上采样和张量拼接;其次,根据多路CO2浓度差异,利用矢量化定位算法定位目标中心位置,校正YOLOv3得到的边界框的中心坐标,提升小目标检测的精度,辅助气道位置的定位;最后,基于该算法,研发了新型多模态气管插管辅助装置初代样机,并在模拟气道中进行实验,验证其可行性。在模拟气道中,该新型辅助装置的操作时间中位数为15.5 s,操作成功率可达97.3%。研究结果表明,基于深度学习的多模态气管插管智能目标检测算法能够有效地辅助气管插管操作。
In order to solve the small angle of the endoscopic view,large changes of target scale and mutual occlusion during endotracheal intubation in difficult airways,a multi-modal intelligent target detection algorithm for endotracheal intubation based on deep learning was proposed with a combination of endoscopic images and carbon dioxide concentration information.First,the traditional YOLOv3 network was improved.It adopted parallel multi-branch dilated convolution block with different dilated rates to extract more information,and up-sampled the output features and concatenated these tensors.Second,the vector localization algorithm was applied to locate the center of the target according to the difference of multi-channel carbon dioxide concentration,so as to further correct the center position of the boundary box predicted by YOLOv3 network.It helped improve the accuracy of small target detection and assisted to locate airway.Finally,a prototype of the new multimodal endotracheal intubation assistant device was developed based on the proposed algorithm,and tested in a simulated airway to verify its feasibility.The effect of the prototype was satisfactory with a median operation time of 15.5 s and a success rate of 97.3%.The study shows that the multi-modal intelligent target detection algorithm for endotracheal intubation based on deep learning has good operation results and can effectively assist endotracheal intubation.
作者
徐天意
夏明
李峰
常敏
姜虹
XU Tianyi;XIA Ming;LI Feng;CHANG Min;JIANG Hong(Department of Anesthesia,Shanghai Ninth People's Hospital,School of Medicine,Shanghai Jiaotong University,Shanghai 200011,China;Key Laboratory of the Ministry of Education on Optical Technology and Instrument for Medicine,University of Shanghai for Science and Technology,Shanghai 200093,China)
出处
《上海理工大学学报》
CAS
CSCD
北大核心
2021年第5期436-442,483,共8页
Journal of University of Shanghai For Science and Technology
基金
上海市科委生药支撑项目(18441904600)
上海申康中心临床技能与临床创新三年行动计划(SHDC2020CR3043B)。
关键词
深度学习
多模态
卷积神经网络
目标检测
deep learning
multimodal
convolutional neural network
target detection
