Visual Question Answering of Remote Sensing Image Based on Attention Mechanism - IFIP Open Digital Library
Conference Papers Year : 2022

Visual Question Answering of Remote Sensing Image Based on Attention Mechanism

Abstract

In recent years, the research of attention mechanism has made significant progress in the field of computer vision. In the processing of visual problems of remote sensing images, the attention mechanism can make the computer focus on important image areas and improve the accuracy of question answering. Our research focuses on the role of synergistic attention mechanisms in the interaction of question representations and visual representations. On the basis of Modular Collaborative Attention (MCA), according to the complementary characteristics of global features and local features, the hybrid connection strategy is used to perceive global features at the same time without weakening the attention distribution of local features. The impact of attention mechanisms on various types of visual question answering questions has been evaluated:(i) scene classification (ii)object comparison (iii) quantitative statistics (iv) relational judgment. By fusing the global features and local features of different modalities, the model can obtain more information between modalities. Model performance evaluation under the RSVQA-LR dataset. Experimental results show, the method in this paper improves the global accuracy by 9.81% than RSVQA.
Embargoed file
Embargoed file
0 0 11
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04666451 , version 1 (01-08-2024)

Licence

Identifiers

Cite

Shihuai Zhang, Qiang Wei, Yangyang Li, Yanqiao Chen, Licheng Jiao. Visual Question Answering of Remote Sensing Image Based on Attention Mechanism. 5th International Conference on Intelligence Science (ICIS), Oct 2022, Xi'an, China. pp.228-238, ⟨10.1007/978-3-031-14903-0_25⟩. ⟨hal-04666451⟩
22 View
1 Download

Altmetric

Share

More