Abstract
Ship detection research has made great progress with deep learning method in recent years. Because some ship targets are too small and the complex scenes are difficult to distinguish from the ship, the accuracy of small-target ship detection in synthetic aperture radar (SAR) images still requires improvement. In order to effectively reduce the interference of complex scenes and locate the small-target more precisely, we propose a model (Dense-YOLOv4-CBAM) based on a densely connected deep neural network with an attention mechanism. The main improvements and contributions of our propose model are three aspects. First, the dense connections is increased in the backbone network (CSP-Darknet53) based on the YOLOv4 framework to enhance the transmission of image features. Second, to refine the transmission of top-down semantic features and bottom-up positioning features in the feature fusion module, we notivatively insert a spatial and channel convolutional attention mechanism (CBAM) into the feature fusion module. This mechanism can reduce the interference in complex scenes and enable a more effective use of each layer’s features to reduce the loss of the semantic information of small targets. Finally, we introduce two kinds of accuracy evaluation metrics to evaluate the effectiveness and robustness of the proposed method in extensive experiments. The results show that the proposed model achieves an optimal performance between the accuracy and calculation time compared to other state-of-the-art detection methods on public synthetic aperture radar ship detection datasets.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
An Q, Pan Z, Liu L, You H (2019) Drbox-v2: an improved detector with rotatable boxes for target detection in sar images. IEEE Trans Geosci Remote Sens 57(99):8333–8349
Bochkovskiy A, Wang CY, Liao HYM (2020) Yolov4: Optimal speed and accuracy of object detection. arXiv:2004.10934
Brusch S, Lehner Fritz T, Soccorsi M, Van Soloviev A (2011) Ship surveillance with terrasar-x. IEEE Trans Geosci Remote Sens
Chang YL, Anagaw A, Chang L, Wang YC, Hsiao CY, Lee WH (2019) Ship detection based on yolov2 for sar imagery. Remote Sens 11(7)
Chen C, Liu MY, Tuzel O, Xiao J (2016) R-cnn for small object detection. Springer, Cham
Chen X, Peng X, Peng Y, Li JB (2016) The classification of synthetic aperture radar image target based on deep learning. J Inf Hiding Multim Signal Process 7(6):1345–1353
Crisp DJ (2013) A ship detection system for radarsat-2 dual-pol multi-look imagery implemented in the adss. In: International conference on radar
Cui Z, Li Q, Cao Z, Liu N (2019) Dense attention pyramid networks for multi-scale ship detection in sar images. IEEE Trans Geosci Remote Sens 57(11):8983–8997
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. IEEE
Henschel M, Rey MT, Campbell JW, Petrovic D (1998) Comparison of probability statistics for automated ship detection in sar imagery. Proceedings of SPIE - The international society for optical engineering 3491:986–991
Huang G, Liu Z, Laurens V, Weinberger KQ (2016) Densely connected convolutional networks. IEEE Computer Society
Huang KW, Lin CC, Lee YM, Wu ZX (2019) A deep learning and image recognition system for image recognition. Data Science and Pattern Recognition 3(2):1–11
Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift JMLR.org
Jiao J, Zhang Y, Sun H, Yang X, Gao X, Hong W, Fu K, Sun X (2018) A densely connected end-to-end neural network for multiscale and multiscene sar ship detection. IEEE Access 6:20881–20892
Jie H, Li S, Gang S, Albanie S (2017) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell pp (99)
Kang M, Ji K, Leng X, Lin Z (2017) Contextual region-based convolutional neural network with multilayer fusion for sar ship detection. Remote Sens 9(8). https://doi.org/10.3390/rs9080860
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25(2)
Li J, Qu C, Shao J (2017) Ship detection in sar images based on an improved faster r-cnn. In: Sar in big data era: models, Methods & Applications
Lin TY, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2016) Feature pyramid networks for object detection. IEEE
Liu LS, He DW, Ma Y, Zhang XZ, Huang J, Li JN, Yao J.X (2020) A novel license plate location method based on deep learning. J Netw Intell 5(3):93–101
Liu S, Huang D et al (2018) Receptive field block net for accurate and fast object detection. In: Proceedings of the european conference on computer vision (ECCV), pp. 385–400
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. In: European conference on computer vision
Mao Y, Yang Y, Ma Z, Li M, Zhang J (2020) Efficient low-cost ship detection for sar imagery based on simplified u-net. IEEE Access PP(99):1–1
Pinheiro PO, Collobert R (2015) Weakly supervised semantic segmentation with convolutional networks. Eprint Arxiv
Redmon J, Divvala S, Girshick R, Farhadi A (2015) You only look once: unified, real-time object detection. IEEE Computer Society
Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. IEEE, 6517–6525
Redmon J, Farhadi A (2018) Yolov3: An incremental improvement. arXiv e-prints
Ren S, He K, Girshick R, Sun J (2017) Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149
Rezatofighi H, Tsoi N, Gwak J, Sadeghian A, Reid I, Savarese S (2019) Generalized intersection over union: a metric and a loss for bounding box regression. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR)
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Computer Science
Staglianò D., Lupidi A, Berizzi F (2012) Ship detection from sar images based on cfar and wavelet transform. In: radar & remote sensing
Szegedy C, Wei L, Jia Y, Sermanet P, Rabinovich A (2014) Going deeper with convolutions. IEEE Computer Society
Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, pp 6105–6114
Torres R, Snoeij P, Geudtner D, Bibby D, Davidson M, Attema E, Potin P, Rommen B, Floury N, Brown M, Traver IN, Deghaye P, Duesmann B, Rosich B, Miranda N, Bruno C, L’Abbate M, Croci R, Pietropaolo A, Huchler M, Rostan F (2012) Gmes sentinel-1 mission. Remote Sens Environ 120(none):9–24
Wang R, Huang Y, Zhang Y, Pei J, Yang J (2019) An inshore ship detection method in sar images based on contextual fluctuation information. In: 2019 6Th asia-pacific conference on synthetic aperture radar (APSAR)
Wang Y, Chao W, Hong Z, Cheng Z, Fu Q (2017) Combing single shot multibox detector with transfer learning for ship detection using chinese gaofen-3 images. In: 2017 Progress in electromagnetics research symposium - fall (PIERS - FALL)
Woo S, Park J, Lee JY, Kweon IS (2018) Cbam: Convolutional block attention module. Springer, Cham
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision. Springer, pp 818–833
Zhang SW (2019) Depthwise separable convolution neural network for high-speed sar ship detection. Remote Sens 11(21):2483
Zhang T, Zhang X, Shi J, Wei S (2020) Hyperli-net: a hyper-light deep learning network for high-accurate and high-speed ship detection from synthetic aperture radar imagery. ISPRS J Photogramm Remote Sens 167:123–153
Zhao L, Ji K, Leng X, Kuang G (2018) Squeeze and excitation rank faster r-cnn for ship detection in sar images. IEEE Geoscience and Remote Sensing Letters PP(99):1–5
Zheng Z, Wang P, Liu W, Li J, Ren D (2020) Distance-iou loss: Faster and better learning for bounding box regression. In: AAAI Conference on artificial intelligence
Zhirui Y, Wen-hui Y (2020) Kun: Air-sarship-1.0: High-resolution sar ship detection dataset
Zhu C, Zhou H, Wang R, Guo J (2010) A novel hierarchical method of ship detection from spaceborne optical image based on shape and texture features. IEEE Trans Geosci Remote Sens 48(9):3446–3456
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sun, B., Wang, X., Li, H. et al. Small-target ship detection in SAR images based on densely connected deep neural network with attention in complex scenes. Appl Intell 53, 4162–4179 (2023). https://doi.org/10.1007/s10489-022-03683-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-022-03683-1