干旱区生态环境知识资源中心(Arid): Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease

Arid

DOI	10.1016/j.bspc.2024.106404
	Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease
	Jia, Nana; Jia, Tong; Zhao, Li; Ma, Bowen; Zhu, Zheyi
通讯作者	Jia, T
来源期刊	BIOMEDICAL SIGNAL PROCESSING AND CONTROL
ISSN	1746-8094
EISSN	1746-8108
出版年	2024
卷号	95
英文摘要	Alzheimer's disease is a complex neurodegenerative disease. Subjects with Mild Cognitive Impairment will progress to Alzheimer's disease, thus how to effectively diagnose Alzheimer's disease or Mild Cognitive Impairment using the clinical tabular data and Magnetic Resonance Images of the brain together has been a major concern of researches. Deep multi -modal learning -based methods can improve Alzheimer's disease diagnostic accuracy compared to the single modality -based methods. However, most existing multi -modal fusion methods only focus on learning global features fusion from image and clinical tabular data by concatenation, lacking the ability to jointly analyze and integrate global-local information of image with clinical tabular data. To address these limitations, this paper explored a novel Multi -Modal Global-Local Fusion method to perform multi -modal Alzheimer's disease classification through 3D Magnetic Resonance Images and clinical tabular data. Specifically, we adopt a global module that uses concatenation to fuse features to learn the global information. Moreover, we design an attention -based local module which encourages clinical tabular features to guide the learning of local 3D Magnetic Resonance Images information, thus, enhancing the power of features fusion from each modality. Our method considers both global and local information of the two modalities for multi -modal fusion. Experiment results show that our method in this paper is highly effective in combining 3D Magnetic Resonance Images and clinical tabular data for Alzheimer's disease classification with accuracy of 86.34% and 86.77% in ADNI and OASIS -1 datasets respectively, which outperforms the current state-of-the-art methods. Detailed ablation experiments are conducted to highlight the contribution of various components. code is available at: https://github.com/nananana0701/MMGLF.
英文关键词	Alzheimer's disease diagnosis Mild cognitive impairment Multi-modal learning Global-Local fusion
类型	Article
语种	英语
收录类别	SCI-E
WOS记录号	WOS:001239334700001
WOS关键词	FUSION ; MEMORY ; WIDE ; MRI
WOS类目	Engineering, Biomedical
WOS研究方向	Engineering
资源类型	期刊论文
条目标识符	http://119.78.100.177/qdio/handle/2XILL650/403033
推荐引用方式 GB/T 7714	Jia, Nana,Jia, Tong,Zhao, Li,et al. Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease[J],2024,95.
APA	Jia, Nana,Jia, Tong,Zhao, Li,Ma, Bowen,&Zhu, Zheyi.(2024).Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease.BIOMEDICAL SIGNAL PROCESSING AND CONTROL,95.
MLA	Jia, Nana,et al."Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease".BIOMEDICAL SIGNAL PROCESSING AND CONTROL 95(2024).