融合注意力机制的TransGLnet脉络膜自动分割

黄文博; 屈超凡; 燕杨

doi:10.37188/OPE.20233123.3482

您当前的位置：

首页 >

文章列表页 >

融合注意力机制的TransGLnet脉络膜自动分割

信息科学 | 更新时间：2023-12-13

- 融合注意力机制的TransGLnet脉络膜自动分割
- Automatic segmentation of choroid by TransGLnet integrating attention mechanism
- 光学精密工程 2023年31卷第23期页码：3482-3489
- 作者机构：
  
  1.长春师范大学计算机科学与技术学院，吉林长春 130032
- 作者简介：
  
  [ "黄文博（1980-），男，吉林长春人，博士，教授，硕士生导师，2018年于吉林大学获得博士学位，主要从事模式识别、图像处理及自然语言处理方面的研究。E-mail： huangwenbo@sina.com" ]
  屈超凡（1999-），男，江苏南通人，硕士研究生，主要从事医学图像自动分割算法的研究。E-mail： fcqkkzy@163.com
- 基金信息：
  
  吉林省科技厅自然科学基金（联合基金项目）(YDZJ202101ZYTS147)
- DOI：10.37188/OPE.20233123.3482
  中图分类号：
扫描看全文
黄文博,屈超凡,燕杨.融合注意力机制的TransGLnet脉络膜自动分割[J].光学精密工程,2023,31(23):3482-3489.

HUANG Wenbo,QU Chaofan,YAN Yang.Automatic segmentation of choroid by TransGLnet integrating attention mechanism[J].Optics and Precision Engineering,2023,31(23):3482-3489.
黄文博,屈超凡,燕杨.融合注意力机制的TransGLnet脉络膜自动分割[J].光学精密工程,2023,31(23):3482-3489. DOI： 10.37188/OPE.20233123.3482.

HUANG Wenbo,QU Chaofan,YAN Yang.Automatic segmentation of choroid by TransGLnet integrating attention mechanism[J].Optics and Precision Engineering,2023,31(23):3482-3489. DOI： 10.37188/OPE.20233123.3482.

摘要

针对脉络膜与巩膜间对比度低，脉络膜分割存在脉络膜下边界模糊，难以界定等问题，提出了融合注意力机制的TransGLnet脉络膜自动分割网络，在卷积层引入全局注意力模块（Global Attention Module，GAM），在特征之间应用矩阵乘法，在整体空间位置的多个特征之间建立非线性交互，在不使用大量参数的情况下提取全局特征；在卷积层和Transformer编码器之间引入局部注意力模块（Local Attention Module，LAM），以1/4特征图为基本单元探索局部特征，特征图元素位置移动规则为保持行位置的元素不变，将列位置的元素由大到小重新排列。两模块融合可令网络有效兼顾全局与局部特征。实验结果表明，TransGLnet网络的Dice值为0.91，准确率为0.98，平均交并比为0.89，F1值为0.90，豪斯多夫距离为6.56。与现有脉络膜自动分割方法相比，本文方法的各项性能指标均有提高。TransGLnet脉络自动分割网络具有较好的稳定性，可供临床借鉴。

Abstract

Addressing the challenge posed by the low contrast between the choroid and sclera in choroid segmentation， this research introduces the TransGLnet choroid automatic segmentation network， employing an attention mechanism. The incorporation of a Global Attention Module （GAM） within the convolutional layer involves matrix multiplication between features， establishing nonlinear interactions across multiple features in the global spatial context. This enables the extraction of global features without an excessive number of parameters. To explore local features， a Local Attention Module （LAM） is introduced between the convolution layer and Transformer encoder， focusing on a 1/4 feature graph. The movement rule for feature graph elements maintains row position consistency while rearranging elements in the column position from largest to smallest. The integration of these two modules ensures that the network effectively considers both global and local features. Experimental results showcase the efficacy of the proposed TransGLnet network with a Dice value of 0.91， accuracy at 0.98， equal crossover ratio of 0.89， F1 value reaching 0.90， and a Hausdorff distance of 6.56. Comparative analysis against existing automatic choroidal segmentation methods reveals notable improvements in performance metrics. The network presented in this study demonstrates robustness and stability， rendering it suitable for clinical reference.

关键词

医学图像处理脉络膜自动分割TransUnet全局注意力局部注意力

Keywords

medical image processingautomatic choroidal segmentationTransUnetglobal attentionlocal attention

references

NICKLA D L， WALLMAN J. The multifunctional choroid［J］. Progress in Retinal and Eye Research， 2010， 29（2）： 144-168. doi: 10.1016/j.preteyeres.2009.12.002http://dx.doi.org/10.1016/j.preteyeres.2009.12.002

ALONSO-CANEIRO D， READ S A， COLLINS M J. Automatic segmentation of choroidal thickness in optical coherence tomography［J］. Biomedical Optics Express， 2013， 4（12）： 2795-2812. doi: 10.1364/boe.4.002795http://dx.doi.org/10.1364/boe.4.002795

TIAN J， MARZILIANO P， BASKARAN M， et al. Automatic measurements of choroidal thickness in EDI-OCT images［C］. 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. August 28-September 1， 2012. San Diego， CA. IEEE， 2012： 5360-5363. doi: 10.1109/embc.2012.6347205http://dx.doi.org/10.1109/embc.2012.6347205

YAN Q F， GU Y Y， ZHAO J Y， et al. Automatic choroid layer segmentation in OCT images via context efficient adaptive network［J］. Applied Intelligence， 2023， 53（5）： 5554-5566.

许祥丛，陈俊彦，王雪花，等. 通过SEC-UNet精准分割糖尿病视网膜病变眼底OCT图像脉络膜层［J］. 生物化学与生物物理进展， 2022， 49（12）： 2450-2457.

XU X C， CHEN J Y， WANG X H， et al. Accurate segmentation of choroidal layer in OCT images of diabetic retinopathy by SEC-UNet［J］. Progress in Biochemistry and Biophysics， 2022， 49（12）： 2450-2457.（in Chinese）

ZHU L， LI J M， ZHU R L， et al. Synergistically segmenting choroidal layer and vessel using deep learning for choroid structure analysis［J］. Physics in Medicine and Biology， 2022， 67（8）. DOI： 10.1088/1361-6560/ac5ed7http://dx.doi.org/10.1088/1361-6560/ac5ed7.

KHAING T T， OKAMOTO T， YE C， et al. ChoroidNET： a dense dilated U-net model for choroid layer and vessel segmentation in optical coherence tomography images［J］. IEEE Access， 2021， 9： 150951-150965. doi: 10.1109/access.2021.3124993http://dx.doi.org/10.1109/access.2021.3124993

XU X C， WANG X H， LIN J Y， et al. Automatic segmentation and measurement of choroid layer in high myopia for OCT imaging using deep learning［J］. Journal of Digital Imaging， 2022， 35（5）： 1153-1163. doi: 10.1007/s10278-021-00571-xhttp://dx.doi.org/10.1007/s10278-021-00571-x

WU W J， GONG Y， HAO H Y， et al. Choroidal layer segmentation in OCT images by a boundary enhancement network［J］. Frontiers in Cell and Developmental Biology， 2022， 10： 1060241. doi: 10.3389/fcell.2022.1060241http://dx.doi.org/10.3389/fcell.2022.1060241

WANG X L， GIRSHICK R， GUPTA A， et al. Non-local neural networks［C］. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 18-23， 2018. Salt Lake City， UT， USA. IEEE， 2018： 7794-7803.

XU L， WANG L， LI Y， et al. Big Model and Small Model： remote modeling and local information extraction module for medical image segmentation［J］. Applied Soft Computing， 2023， 136： 110128. doi: 10.1016/j.asoc.2023.110128http://dx.doi.org/10.1016/j.asoc.2023.110128

CHEN J， LU Y， YU Q， et al. TransUNet： Transformers Make Strong Encoders for Medical Image Segmentation［EB/OL］. 2021： arXiv： 2102. 04306. https：//arxiv.org/abs/2102.04306.pdfhttps://arxiv.org/abs/2102.04306.pdf.

HE K M， ZHANG X Y， REN S Q， et al. Deep residual learning for image recognition［C］. 2016 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. June 27-30， 2016. Las Vegas， NV， USA. IEEE， 2016： 770-778.

MILLETARI F， NAVAB N， AHMADI S A. V-net： Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation［EB/OL］. 2016： arXiv： 1606.04797. https：//arxiv.org/abs/1606.04797.pdfhttps://arxiv.org/abs/1606.04797.pdf. doi: 10.1109/3dv.2016.79http://dx.doi.org/10.1109/3dv.2016.79

KERMANY D， ZHANG K， GOLDBAUM M. Labeled optical coherence tomography （oct） and chest x-ray images for classification［J］. Mendeley data， 2018， 2（2）： 651.

RONNEBERGER O, FISCHER P, BROX T. U-net: Convolutional networks for biomedical image segmentation[C]. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings,Part III 18. Springer International Publishing, 2015: 234-241. doi: 10.1007/978-3-319-24574-4_28http://dx.doi.org/10.1007/978-3-319-24574-4_28

WANG S, LI L, ZHUANG X. AttU-Net: attention U-Net for brain tumor segmentation[C]. International MICCAI Brainlesion Workshop. Cham: Springer International Publishing, 2021: 302-311. doi: 10.1007/978-3-031-09002-8_27http://dx.doi.org/10.1007/978-3-031-09002-8_27

ALOM M Z, HASAN M, YAKOPCIC C, et al. Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation[J]. arXiv preprint arXiv:1802.06955, 2018. doi: 10.1109/naecon.2018.8556686http://dx.doi.org/10.1109/naecon.2018.8556686

ZUO Q, CHEN S, WANG Z. R2AU-Net: attention recurrent residual convolutional neural network for multimodal medical image segmentation[J]. Security and Communication Networks, 2021, 2021: 1-10. doi: 10.1155/2021/6625688http://dx.doi.org/10.1155/2021/6625688

CHEN J, LU Y, YU Q, et al. Transunet: Transformers make strong encoders for medical image segmentation[J].arXiv preprint arXiv：2102.04306, 2021.

CAO H, WANG Y, CHEN J, et al. Swin-unet: Unet-likeic pure transformer for medical image segmentation[C]. European Conference on Computer Vision. Cham： Springer Nature Switzerland, 2022: 205-218. doi: 10.1007/978-3-031-25066-8_9http://dx.doi.org/10.1007/978-3-031-25066-8_9

JAEGER S， CANDEMIR S， ANTANI S， et al. Two public chest X-ray datasets for computer-aided screening of pulmonary diseases［J］. Quantitative Imaging in Medicine and Surgery， 2014， 4（6）： 475.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于密集双流聚焦网络的肺炎辅助诊断模型

改进BYOL的非小细胞肺癌表皮生长因子受体基因突变预测

光学相干层析医学图像处理及其应用