{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:50:22Z","timestamp":1732038622161},"reference-count":62,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2019,10,9]],"date-time":"2019-10-09T00:00:00Z","timestamp":1570579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National key research and development project \"integrated aerogeophysical detection system integration and method technology demonstration research\"","award":["2017YFC0602201"]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["201806415026"],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Yield prediction is of great significance for yield mapping, crop market planning, crop insurance, and harvest management. Remote sensing is becoming increasingly important in crop yield prediction. Based on remote sensing data, great progress has been made in this field by using machine learning, especially the Deep Learning (DL) method, including Convolutional Neural Network (CNN) or Long Short-Term Memory (LSTM). Recent experiments in this area suggested that CNN can explore more spatial features and LSTM has the ability to reveal phenological characteristics, which both play an important role in crop yield prediction. However, very few experiments combining these two models for crop yield prediction have been reported. In this paper, we propose a deep CNN-LSTM model for both end-of-season and in-season soybean yield prediction in CONUS at the county-level. The model was trained by crop growth variables and environment variables, which include weather data, MODIS Land Surface Temperature (LST) data, and MODIS Surface Reflectance (SR) data; historical soybean yield data were employed as labels. Based on the Google Earth Engine (GEE), all these training data were combined and transformed into histogram-based tensors for deep learning. The results of the experiment indicate that the prediction performance of the proposed CNN-LSTM model can outperform the pure CNN or LSTM model in both end-of-season and in-season. The proposed method shows great potential in improving the accuracy of yield prediction for other crops like corn, wheat, and potatoes at fine scales in the future.<\/jats:p>","DOI":"10.3390\/s19204363","type":"journal-article","created":{"date-parts":[[2019,10,9]],"date-time":"2019-10-09T15:25:57Z","timestamp":1570634757000},"page":"4363","source":"Crossref","is-referenced-by-count":222,"title":["County-Level Soybean Yield Prediction Using Deep CNN-LSTM Model"],"prefix":"10.3390","volume":"19","author":[{"given":"Jie","family":"Sun","sequence":"first","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"},{"name":"Center for Spatial Information Science and Systems, George Mason University, Fairfax, VA 22030, USA"}]},{"given":"Liping","family":"Di","sequence":"additional","affiliation":[{"name":"Center for Spatial Information Science and Systems, George Mason University, Fairfax, VA 22030, USA"}]},{"given":"Ziheng","family":"Sun","sequence":"additional","affiliation":[{"name":"Center for Spatial Information Science and Systems, George Mason University, Fairfax, VA 22030, USA"}]},{"given":"Yonglin","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"},{"name":"State Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, China"}]},{"given":"Zulong","family":"Lai","sequence":"additional","affiliation":[{"name":"School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liakos, K., Busato, P., Moshou, D., Pearson, S., and Bochtis, D. (2018). Machine Learning in Agriculture: A Review. Sensors, 18.","DOI":"10.3390\/s18082674"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.rse.2018.11.032","article-title":"Deep learning based multi-temporal crop classification","volume":"221","author":"Zhong","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shrestha, R., Di, L., Eugene, G.Y., Kang, L., Li, L., Rahman, M.S., Deng, M., and Yang, Z. (2016, January 18\u201320). Regression based corn yield assessment using MODIS based daily NDVI in Iowa state. Proceedings of the 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics), Tianjin, China.","DOI":"10.1109\/Agro-Geoinformatics.2016.7577657"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/S2095-3119(16)61502-2","article-title":"Regression model to estimate flood impact on corn yield using MODIS NDVI and USDA cropland data layer","volume":"16","author":"Shrestha","year":"2017","journal-title":"J. Integr. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yu, B., and Shang, S. (2018). Multi-Year Mapping of Major Crop Yields in an Irrigation District from High Spatial and Temporal Resolution Vegetation Index. Sensors, 18.","DOI":"10.3390\/s18113787"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7529","DOI":"10.3390\/s120607529","article-title":"Estimating Sugarcane Yield Potential Using an In-Season Determination of Normalized Difference Vegetative Index","volume":"12","author":"Lofton","year":"2012","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1016\/j.envsoft.2007.10.003","article-title":"A simple algorithm for yield estimates: Evaluation for semi-arid irrigated winter wheat monitored with green leaf area index","volume":"23","author":"Duchemin","year":"2008","journal-title":"Environ. Model. Softw."},{"key":"ref_8","first-page":"49","article-title":"Determining CWSI to estimate eggplant evapotranspiration and yield under greenhouse and outdoor conditions","volume":"34","author":"Ghaemi","year":"2016","journal-title":"Iran Agric. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.agrformet.2013.01.007","article-title":"Forecasting crop yield using remotely sensed vegetation indices and crop phenology metrics","volume":"173","author":"Bolton","year":"2013","journal-title":"Agric. For. Meteorol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"673","DOI":"10.3390\/rs2030673","article-title":"Application of Vegetation Indices for Agricultural Crop Yield Prediction Using Neural Network Techniques","volume":"2","author":"Panda","year":"2010","journal-title":"Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xue, J., and Su, B. (2017). Significant Remote Sensing Vegetation Indices: A Review of Developments and Applications. J. Sens.","DOI":"10.1155\/2017\/1353691"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1029\/2017EA000343","article-title":"Using Neural Network Classifier Approach for Statistically Forecasting Extreme Corn Yield Losses in Eastern United States","volume":"5","author":"Mathieu","year":"2018","journal-title":"Earth Space Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"150066","DOI":"10.1038\/sdata.2015.66","article-title":"The climate hazards infrared precipitation with stations\u2014A new environmental record for monitoring extremes","volume":"2","author":"Funk","year":"2015","journal-title":"Sci. Data"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Crane-Droesch, A. (2018). Machine learning methods for crop yield prediction and climate change impact assessment in agriculture. Environ. Res. Lett., 13.","DOI":"10.1088\/1748-9326\/aae159"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1016\/j.agwat.2018.12.005","article-title":"Effects of soil properties, water quality and management practices on pistachio yield in Rafsanjan region, southeast of Iran","volume":"213","author":"Pourmohammadali","year":"2019","journal-title":"Agric. Water Manag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.compag.2016.08.015","article-title":"The effect of tuning, feature engineering, and feature selection in data mining applied to rainfed sugarcane yield modelling","volume":"128","author":"Bocca","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"383","DOI":"10.7848\/ksgpc.2016.34.4.383","article-title":"Machine learning approaches to corn yield estimation using satellite images and climate data: A case of Iowa State","volume":"34","author":"Kim","year":"2016","journal-title":"J. Korean Soc. Surv. Geod. Photogramm. Cartogr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/S2095-3119(18)62110-0","article-title":"Simple model based on artificial neural network for early prediction and simulation winter rapeseed yield","volume":"18","author":"Niedbala","year":"2019","journal-title":"J. Integr. Agric."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/S1002-0160(17)60336-9","article-title":"Estimation of Sunflower Seed Yield Using Partial Least Squares Regression and Artificial Neural Network Models","volume":"28","author":"Wenzhi","year":"2018","journal-title":"Pedosphere"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.still.2019.01.011","article-title":"Prediction of organic potato yield using tillage systems and soil properties by artificial neural network (ANN) and multiple linear regressions (MLR)","volume":"190","author":"Abrougui","year":"2019","journal-title":"Soil Tillage Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1080\/01431161.2018.1488291","article-title":"Regional-scale rice-yield estimation using stacked auto-encoder with climatic and MODIS data: a case study of South Korea","volume":"40","author":"Ma","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kuwata, K., and Shibasaki, R. (2015, January 26\u201331). Estimating crop yields with deep learning and remotely sensed data. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7325900"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nevavuori, P., Narra, N., and Lipping, T. (2019). Crop yield prediction with deep convolutional neural networks. Comput. Electron. Agric., 163.","DOI":"10.1016\/j.compag.2019.104859"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.fcr.2019.02.022","article-title":"Deep convolutional neural networks for rice grain yield estimation at the ripening stage using UAV-based remotely sensed images","volume":"235","author":"Yang","year":"2019","journal-title":"Field Crop. Res."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, Y., Lee, W.S., Gan, H., Peres, N., Fraisse, C., Zhang, Y., and He, Y. (2019). Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages. Remote Sens., 11.","DOI":"10.3390\/rs11131584"},{"key":"ref_26","unstructured":"Russello, H. (2018). Convolutional Neural Networks for Crop Yield Prediction Using Satellite Images. [Master\u2019s Thesis, University of Amsterdam]."},{"key":"ref_27","unstructured":"Jiang, Z., Liu, C., Hendricks, N.P., Ganapathysubramanian, B., Hayes, D.J., and Sarkar, S. (2018). Predicting county level corn yields using deep long short term memory models. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kulkarni, S., Mandal, S.N., Sharma, G.S., Mundada, M.R. (2018, January 19\u201322). Predictive Analysis to Improve Crop Yield using a Neural Network Model. Proceedings of the 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Bangalore, India.","DOI":"10.1109\/ICACCI.2018.8554851"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Haider, S.A., Naqvi, S.R., Akram, T., Umar, G.A., Shahzad, A., Sial, M.R., Khaliq, S., and Kamran, M. (2019). LSTM Neural Network Based Forecasting Model for Wheat Production in Pakistan. Agronomy, 9.","DOI":"10.3390\/agronomy9020072"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"You, J., Li, X., Low, M., Lobell, D., and Ermon, S. (2017, January 4\u20139). Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data. Proceedings of the thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11172"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Alhnaity, B., Pearson, S., Leontidis, G., and Kollias, S. (2019). Using Deep Learning to Predict Plant Growth and Yield in Greenhouse Environments. arXiv.","DOI":"10.17660\/ActaHortic.2020.1296.55"},{"key":"ref_32","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., and Woo, W.C. (2015). Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hird, J.N., DeLancey, E.R., McDermid, G.J., and Kariyeva, J. (2017). Google Earth Engine, Open-Access Satellite Data, and Machine Learning in Support of Large-Area Probabilistic Wetland Mapping. Remote Sens., 9.","DOI":"10.3390\/rs9121315"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1002\/2017EF000536","article-title":"A Global Geospatial Ecosystem Services Estimate of Urban Agriculture","volume":"6","author":"Clinton","year":"2018","journal-title":"Earths Future"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1080\/17538947.2016.1250829","article-title":"Remote sensing heritage in a petabyte-scale: satellite data and heritage Earth Engine (c) applications","volume":"10","author":"Agapiou","year":"2017","journal-title":"Int. J. Digit. Earth"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/feart.2017.00017","article-title":"Exploring Google Earth Engine Platform for Big Data Processing: Classification of Multi-Temporal Satellite Imagery for Crop Mapping","volume":"5","author":"Shelestov","year":"2017","journal-title":"Front. Earth Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.rse.2015.04.021","article-title":"A scalable satellite-based crop yield mapper","volume":"164","author":"Lobell","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.rse.2019.04.016","article-title":"Smallholder maize area and yield mapping at national scales with Google Earth Engine","volume":"228","author":"Jin","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.rse.2017.04.014","article-title":"Towards fine resolution global maps of crop yields: Testing multiple methods and satellites in three countries","volume":"202","author":"Azzari","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, A.X., Tran, C., Desai, N., Lobell, D., and Ermon, S. (2018, January 20\u201322). Deep Transfer Learning for Crop Yield Prediction with Remote Sensing Data. Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies, Menlo Park and San Jose, CA, USA.","DOI":"10.1145\/3209811.3212707"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"163","DOI":"10.3934\/geosci.2017.2.163","article-title":"Combined use of Landsat-8 and Sentinel-2A images for winter crop mapping and winter wheat yield assessment at regional scale","volume":"3","author":"Skakun","year":"2017","journal-title":"AIMS Geosci."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"He, M., Kimball, J.S., Maneta, M.P., Maxwell, B.D., Moreno, A., Beguer\u00eda, S., and Wu, X. (2018). Regional Crop Gross Primary Productivity and Yield Estimation Using Fused Landsat-MODIS Data. Remote Sens., 10.","DOI":"10.3390\/rs10030372"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Goron, T.L., Nederend, J., Stewart, G., Deen, B., and Raizada, M.N. (2017). Mid-Season Leaf Glutamine Predicts End-Season Maize Grain Yield and Nitrogen Content in Response to Nitrogen Fertilization under Field Conditions. Agronomy, 7.","DOI":"10.3390\/agronomy7020041"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.eja.2017.07.005","article-title":"Mid-season prediction of grain yield and protein content of spring barley cultivars using high-throughput spectral sensing","volume":"90","author":"Barmeier","year":"2017","journal-title":"Eur. J. Agron."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Peralta, N.R., Assefa, Y., Du, J., Barden, C.J., and Ciampitti, I.A. (2016). Mid-Season High-Resolution Satellite Imagery for Forecasting Site-Specific Corn Yield. Remote Sens., 8.","DOI":"10.3390\/rs8100848"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.eja.2019.04.007","article-title":"Maize yield estimation in West Africa from crop process-induced combinations of multi-domain remote sensing indices","volume":"108","author":"Leroux","year":"2019","journal-title":"Eur. J. Agron."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Ban, H.Y., Kim, K.S., Park, N.W., and Lee, B.W. (2017). Using MODIS Data to Predict Regional Corn Yields. Remote Sens., 9.","DOI":"10.20944\/preprints201610.0044.v1"},{"key":"ref_48","unstructured":"USDA (2019, September 19). Usda National Agricultural Statistics Service, Available online: https:\/\/www.nass.usda.gov\/Quick_Stats\/index.php\/."},{"key":"ref_49","unstructured":"USDA (2019, September 19). The USDA Economics, Statistics and Market Information System, Available online: https:\/\/usda.library.cornell.edu\/?locale=en."},{"key":"ref_50","unstructured":"USDA-NASS (2019, September 19). USDA National Agricultural Statistics Service Cropland Data Layer, Available online: https:\/\/nassgeodata.gmu.edu\/CropScape."},{"key":"ref_51","unstructured":"Vermote, E. (2015). MOD09A1 MODIS\/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid V006. NASA EOSDIS Land Process. DAAC."},{"key":"ref_52","unstructured":"Wan, Z., Hook, S., and Hulley, G. (2015). MOD11A2 MODIS\/Terra Land Surface Temperature\/Emissivity 8-Day L3 Global 1km SIN Grid V006. NASA EOSDIS Land Process. DAAC."},{"key":"ref_53","unstructured":"Thornton, P., Thornton, M., Mayer, B., Wei, Y., Devarakonda, R., Vose, R.S., and Cook, R. (2016). Daymet: Daily Surface Weather Data on a 1-km Grid for North America, Version 3. ORNL DAAC."},{"key":"ref_54","unstructured":"GEE (2019, September 19). Google Earth Engine. Available online: https:\/\/developers.google.com\/earth-engine."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Huang, C.J., and Kuo, P.H. (2018). A Deep CNN-LSTM Model for Particulate Matter (PM2.5) Forecasting in Smart Cities. Sensors, 18.","DOI":"10.3390\/s18072220"},{"key":"ref_56","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Khaki, S., and Wang, L. (2019). Crop Yield Prediction Using Deep Neural Networks. arXiv.","DOI":"10.3389\/fpls.2019.00621"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","article-title":"Permutation importance: A corrected feature importance measure","volume":"26","author":"Altmann","year":"2010","journal-title":"Bioinformatics"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.wace.2015.10.004","article-title":"The U.S. drought of 2012","volume":"10","author":"Rippey","year":"2015","journal-title":"Weather Clim. Extrem."},{"key":"ref_60","unstructured":"NDMC (2019, September 19). National Drought Mitigation Center. Available online: https:\/\/droughtmonitor.unl.edu\/."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Cogato, A., Meggio, F., Migliorati, M., and Marinello, F. (2019). Extreme Weather Events in Agriculture: A Systematic Review. Sustainability, 11.","DOI":"10.3390\/su11092547"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"4831","DOI":"10.1080\/01431161.2017.1323282","article-title":"Forecasting wheat yield from weather data and MODIS NDVI using Random Forests for Punjab province, Pakistan","volume":"38","author":"Saeed","year":"2017","journal-title":"Int. J. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4363\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,21]],"date-time":"2024-06-21T04:09:09Z","timestamp":1718942949000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,9]]},"references-count":62,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19204363"],"URL":"https:\/\/doi.org\/10.3390\/s19204363","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,9]]}}}
