Skip to main content
Computer Science and Information SystemsVolume 20, Issue 4, September 2023, Pages 1289-1310

M2F2-RCNN: Multi-functional Faster RCNN Based on Multi-scale Feature Fusion for Region Search in Remote Sensing Images(Article)(Open Access)

  • Yin, S.,
  • Wang, L.,
  • Wang, Q.,
  • Ivanović, M.,
  • Yang, J.
  Save all to author list
  • aCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, China
  • bCollege of Information and Communications Engineering, Dalian Minzu University, Dalian, 116000, China
  • cCollege of Surveying and Geo-Informatics, Tongji University, Shanghai, 200092, China
  • dFaculty of Sciences, University of Novi Sad, Novi Sad, 21000, Serbia
  • eSchool of Information Engineering, China University of Geosciences, Beijing, 100083, China

Abstract

In order to realize fast and accurate search of sensitive regions in remote sensing images, we propose a multi-functional faster RCNN based on multi-scale feature fusion model for region search. The feature extraction network is based on ResNet50 and the dilated residual blocks are utilized for multi-layer and multi-scale feature fusion. We add a path aggregation network with a convolution block attention module (CBAM) attention mechanism in the backbone network to improve the efficiency of feature extraction. Then, the extracted feature map is processed, and RoIAlign is used to improve the pooling operation of regions of interest and it can improve the calculation speed. In the classification stage, an improved nonmaximum suppression is used to improve the classification accuracy of the sensitive region. Finally, we conduct cross validation experiments on Google Earth dataset and the DOTA dataset. Meanwhile, the comparison experiments with the state-ofthe-art methods also prove the high efficiency of the proposed method in region search ability. © 2023, ComSIS Consortium. All rights reserved.

Author keywords

convolution block attention modulemulti-functional faster RCNNmulti-scale feature fusionregion searchremote sensing images

Funding details

Funding sponsor Funding number Acronym
National Natural Science Foundation of China62001434,62071084NSFC
  • 1

    Acknowledgments. This work was supported in part by the National Natural Science Foundation of China under Grant 62071084 and National Natural Science Foundation of China under Grant 62001434. Also supported by Talents Project of the State Ethnic Affairs Commission.

  • ISSN: 18200214
  • Source Type: Journal
  • Original language: English
  • DOI: 10.2298/CSIS230315054Y
  • Document Type: Article
  • Publisher: ComSIS Consortium


© Copyright 2023 Elsevier B.V., All rights reserved.

Cited by 2 documents

Zheng, X. , Zhao, X.
Single Shot MultiBox Detector-based Feature Fusion Model For Building Object Detection
(2025) Journal of Applied Science and Engineering
Yin, S. , Wang, L. , Teng, L.
Threshold Segmentation Based on Information Fusion for Object Shadow Detection in Remote Sensing Images
(2024) Computer Science and Information Systems
View details of all 2 citations
{"topic":{"name":"Convolutional Neural Network; Remote Sensing Image; Object Detection","id":17074,"uri":"Topic/17074","prominencePercentile":99.212776,"prominencePercentileString":"99.213","overallScholarlyOutput":0},"dig":"2946694673729b07f30e85e2a0f2dc399467a1f3254f9eb1945eb0f57c005c86"}

SciVal Topic Prominence

Topic:
Prominence percentile: