您当前的位置:
首页 >
文章列表页 >
Collaborative classification of hyperspectral and LiDAR data based on CNN-transformer
Information Sciences | 更新时间:2024-05-06
    • Collaborative classification of hyperspectral and LiDAR data based on CNN-transformer

    • Multimodal classification tasks have made new breakthroughs in the field of remote sensing image processing. In response to the challenges of fusing hyperspectral images (HSI) and LiDAR data, researchers have proposed a CNN Transformer collaborative classification network based on contrastive learning called CLCT Net. The network realizes semantic alignment between different sensor data through an innovative common feature extraction module, and solves the problems of cross modal information representation and feature alignment. The researchers designed a dual branch HSI encoder that includes spatial channel branches and spectral context branches, as well as a LiDAR encoder that combines frequency domain self attention mechanism, in order to fully extract and integrate the rich features of the two types of data. Meanwhile, they ingeniously integrated contrastive learning methods to further improve the accuracy of multimodal data collaborative classification. Experimental verification on the Houston 2013 and Trento datasets showed that the land cover classification accuracy of the CLCT Net model reached 92.01% and 98.90%, respectively, significantly surpassing other similar models. This achievement not only provides powerful tools for deep mining and collaborative extraction of cross modal data features, but also opens up new directions for research on multimodal classification tasks in the field of remote sensing image processing.
    • Optics and Precision Engineering   Vol. 32, Issue 7, Pages: 1087-1100(2024)
    • DOI:10.37188/OPE.20243207.1087    

      CLC: TP394.1;TH691.9
    • Received:23 October 2023

      Revised:20 November 2023

      Published:10 April 2024

    移动端阅览

  • WU Haibin,DAI Shiyu,WANG Aili,et al.Collaborative classification of hyperspectral and LiDAR data based on CNN-transformer[J].Optics and Precision Engineering,2024,32(07):1087-1100. DOI: 10.37188/OPE.20243207.1087.

  •  
  •  

0

Views

481

下载量

0

CSCD

Alert me when the article has been cited
提交
Tools
Download
Export Citation
Share
Add to favorites
Add to my album

Related Articles

Progressive CNN-transformer semantic compensation network for polyp segmentation
Cascade residual-optimized image super-resolution reconstruction in Transformer network
Specral-spatial classification of hyperspectral imagery with hybrid architecture of 3D-CNN and Transformer
Iterative reconstruction of compressive sensing combining image hierarchical-feature
Real-time urban street view semantic segmentation based on cross-layer aggregation network

Related Author

LI Daxiang
LI Denghui
LIU Ying
TANG Yao
LIN Jianpu
WU Zhencheng
WANG Kunfu
LIN Zhixian

Related Institution

College of Communication and Information Engineering,Xi′an University of Posts and Telecommunication,Xi′an
College of Physics and Telecommunication Engineering, Fuzhou University
Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China
School of Advanced Manufacturing, Fuzhou University
Northwestern Polytechnical University
0