{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T16:58:42Z","timestamp":1726851522987},"reference-count":44,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,18]],"date-time":"2023-01-18T00:00:00Z","timestamp":1674000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62201429","62192714"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fund for Foreign Scholars in University Research and Teaching Programs","award":["B18039"]},{"name":"stabilization support of National Radar Signal Processing Laboratory","award":["KGJ202X0X"]},{"name":"undamental Research Funds for the Central Universities","award":["QTZX22160"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"In modern electronic warfare, the intelligence of the jammer greatly worsens the anti-jamming performance of traditional passive suppression methods. How to actively design anti-jamming strategies to deal with intelligent jammers is crucial to the radar system. In the existing research on radar anti-jamming strategies\u2019 design, the assumption of jammers is too ideal. To establish a model that is closer to real electronic warfare, this paper explores the intelligent game between a subpulse-level frequency-agile (FA) radar and a transmit\/receive time-sharing jammer under jamming power dynamic allocation. Firstly, the discrete allocation model of jamming power is established, and the multiple-round sequential interaction between the radar and the jammer is described based on an extensive-form game. A detection probability calculation method based on the signal-to-interference-pulse-noise ratio (SINR) accumulation gain criterion (SAGC) is proposed to evaluate the game results. Secondly, considering that the competition between the radar and the jammer has the feature of imperfect information, we utilized neural fictitious self-play (NFSP), an end-to-end deep reinforcement learning (DRL) algorithm, to find the Nash equilibrium (NE) of the game. Finally, the simulation results showed that the game between the radar and the jammer can converge to an approximate NE under the established model. The approximate NE strategies are better than the elementary strategies from the perspective of detection probability. In addition, comparing NFSP and the deep Q-network (DQN) illustrates the effectiveness of NFSP in solving the NE of imperfect information games.<\/jats:p>","DOI":"10.3390\/rs15030581","type":"journal-article","created":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T10:06:14Z","timestamp":1674122774000},"page":"581","source":"Crossref","is-referenced-by-count":12,"title":["Radar and Jammer Intelligent Game under Jamming Power Dynamic Allocation"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-2027-6699","authenticated-orcid":false,"given":"Jie","family":"Geng","sequence":"first","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Bo","family":"Jiu","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Kang","family":"Li","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Yu","family":"Zhao","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Hongwei","family":"Liu","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Hailin","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Institute of Tracking and Telecommunication Technology, Beijing 100094, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102806","DOI":"10.1016\/j.dsp.2020.102806","article-title":"Mainlobe jamming suppression with polarimetric multi-channel radar via independent component analysis","volume":"106","author":"Ge","year":"2020","journal-title":"Digit. Signal Process."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, K., Jiu, B., Liu, H., and Pu, W. (2021). Robust antijamming strategy design for frequency-agile radar against main lobe jamming. Remote Sens., 13.","DOI":"10.3390\/rs13153043"},{"key":"ref_3","unstructured":"Su, B., Wang, Y., and Zhou, L. (2005, January 8\u201312). A mainlobe interference cancelling method. Proceedings of the 2005 IEEE International Symposium on Microwave, Antenna, Propagation and EMC Technologies for Wireless Communications, Beijing, China."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1587\/transfun.E100.A.1055","article-title":"Mainlobe anti-jamming via eigen-projection processing and covariance matrix reconstruction","volume":"100","author":"Luo","year":"2017","journal-title":"IEICE Trans. Fundam. Electron. Commun. Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ge, M., Cui, G., Yu, X., Huang, D., and Kong, L. (2018, January 23\u201327). Mainlobe jamming suppression via blind source separation. Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA.","DOI":"10.1109\/RADAR.2018.8378682"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1049\/iet-rsn.2019.0500","article-title":"Main lobe jamming suppression via blind source separation sparse signal recovery with subarray configuration","volume":"14","author":"Ge","year":"2020","journal-title":"IET Radar Sonar Navig."},{"key":"ref_7","unstructured":"Neri, F. (2006). Introduction to Electronic Defense Systems, SciTech Publishing."},{"key":"ref_8","unstructured":"De Martino, A. (2018). Introduction to Modern EW Systems, Artech House."},{"key":"ref_9","unstructured":"Zhou, R., Xia, G., Zhao, Y., and Liu, H. (2015, January 16\u201318). Coherent signal processing method for frequency-agile radar. Proceedings of the 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI), Qingdao, China."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1109\/TGRS.2006.888865","article-title":"Analysis of random step frequency radar and comparison with experiments","volume":"45","author":"Axelsson","year":"2007","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1049\/iet-rsn.2017.0421","article-title":"Range Doppler reconstruction for frequency agile and PRF-jittering radar","volume":"12","author":"Quan","year":"2018","journal-title":"IET Radar Sonar Navig."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"094703","DOI":"10.1063\/1.4962700","article-title":"Moving target detection for frequency agility radar by sparse reconstruction","volume":"87","author":"Quan","year":"2016","journal-title":"Rev. Sci. Instruments"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Aziz, M.M., Maud, A.R.M., and Habib, A. (2021, January 12\u201316). Reinforcement Learning Based Techniques for Radar Anti-Jamming. Proceedings of the 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST), Islamabad, Pakistan.","DOI":"10.1109\/IBCAST51254.2021.9393209"},{"key":"ref_14","unstructured":"Li, K., Jiu, B., Liu, H., and Liang, S. (2018, January 14\u201316). Reinforcement learning based anti-jamming frequency hopping strategies design for cognitive radar. Proceedings of the 2018 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Qingdao, China."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, K., Jiu, B., and Liu, H. (2019, January 23\u201327). Deep q-network based anti-jamming strategy design for frequency agile radar. Proceedings of the 2019 International Radar Conference (RADAR), Toulon, France.","DOI":"10.1109\/RADAR41533.2019.171227"},{"key":"ref_16","unstructured":"Yi, W., and Yuan, Y. (2020, January 21\u201325). Reinforcement learning-based joint adaptive frequency hopping and pulse-width allocation for radar anti-jamming. Proceedings of the 2020 IEEE Radar Conference (RadarConf20), Florence, Italy."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"108130","DOI":"10.1016\/j.sigpro.2021.108130","article-title":"Radar active antagonism through deep reinforcement learning: A Way to address the challenge of mainlobe jamming","volume":"186","author":"Li","year":"2021","journal-title":"Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, L., Peng, J., Xie, Z., and Zhang, Y. (2019, January 28\u201330). Optimal jamming frequency selection for cognitive jammer based on reinforcement learning. Proceedings of the 2019 IEEE 2nd International Conference on Information Communication and Signal Processing (ICICSP), Weihai, China.","DOI":"10.1109\/ICICSP48821.2019.8958575"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, H., He, Y., and Sun, Y. (2021). Jamming Strategy Optimization through Dual Q-Learning Model against Adaptive Radar. Sensors, 22.","DOI":"10.3390\/s22010145"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dong, H., Ding, Z., and Zhang, S. (2020). Deep Reinforcement Learning, Springer.","DOI":"10.1007\/978-981-15-4095-0"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/TAES.2011.5751244","article-title":"Game theoretic analysis of adaptive radar jamming","volume":"47","author":"Bachmann","year":"2011","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1049\/iet-rsn.2012.0049","article-title":"Scheduling the usage of radar and jammer during peace and war time","volume":"6","author":"Norouzi","year":"2012","journal-title":"IET Radar Sonar Navig."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1109\/TSP.2011.2169251","article-title":"The MIMO radar and jammer games","volume":"60","author":"Song","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6912","DOI":"10.1109\/JSEN.2015.2466812","article-title":"MIMO radar and target Stackelberg game in the presence of clutter","volume":"15","author":"Lan","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5533","DOI":"10.1109\/TAES.2022.3175186","article-title":"Neural Fictitious Self-Play for Radar Antijamming Dynamic Game With Imperfect Information","volume":"58","author":"Li","year":"2022","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_26","unstructured":"Chen, B. (2012). Modern Radar System Analysis And Design, Publishing House of Xidian University."},{"key":"ref_27","unstructured":"Myerson, R.B. (1997). Game Theory: Analysis of Conflict, Harvard University Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3137","DOI":"10.1109\/TAES.2013.120040","article-title":"Detection performance of spatial-frequency diversity MIMO radar","volume":"50","author":"Liu","year":"2014","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4389","DOI":"10.1109\/TSP.2016.2566610","article-title":"Generalized multicarrier radar: Models and performance","volume":"64","author":"Koivunen","year":"2016","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_30","unstructured":"Adamy, D. (2001). EW 101: A First Course in Electronic Warfare, Artech House."},{"key":"ref_31","unstructured":"Heinrich, J., Lanctot, M., and Silver, D. (2015, January 7\u20139). Fictitious self-play in extensive-form games. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_32","unstructured":"Richards, M.A. (2014). Fundamentals of Radar Signal Processing, McGraw-Hill Education."},{"key":"ref_33","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_36","unstructured":"Heinrich, J., and Silver, D. (2016). Deep reinforcement learning from self-play in imperfect-information games. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1145\/3147.3165","article-title":"Random sampling with a reservoir","volume":"11","author":"Vitter","year":"1985","journal-title":"ACM Trans. Math. Softw. (TOMS)"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1109\/TAC.2005.843878","article-title":"Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria","volume":"50","author":"Shamma","year":"2005","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_40","unstructured":"Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., and Freitas, N. (2016, January 20\u201322). Dueling network architectures for deep reinforcement learning. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_41","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_42","unstructured":"Zinkevich, M., Johanson, M., Bowling, M., and Piccione, C. (2007, January 3\u20136). Regret minimization in games with incomplete information. Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada."},{"key":"ref_43","unstructured":"Johanson, M., Waugh, K., Bowling, M., and Zinkevich, M. (2011, January 16\u201322). Accelerating best response calculation in large extensive games. Proceedings of the Twenty-second International Joint Conference on Artificial Intelligence, Barcelona, Spain."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Davis, T., Burch, N., and Bowling, M. (2014, January 1\u20134). Using response functions to measure strategy strength. Proceedings of the AAAI Conference on Artificial Intelligence, Ann Arbor, MI, USA.","DOI":"10.1609\/aaai.v28i1.8830"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/581\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T10:11:47Z","timestamp":1724580707000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/581"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,18]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["rs15030581"],"URL":"https:\/\/doi.org\/10.3390\/rs15030581","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,1,18]]}}}
