Automatic Monitoring of Maize Seedling Growth Using Unmanned Aerial Vehicle-Based RGB Imagery
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Site and Data Acquisition
2.2. Maize Seedling Center Detection
2.2.1. Construction of Maize Seedling Center Detection Index (MCDI)
2.2.2. Otsu Threshold Segmentation
2.3. Maize Seedling Counting
2.3.1. Morphological Processing
2.3.2. Connected Component Labeling
- (1)
- The binary image was scanned line by line from top to bottom. The line number, starting point, and ending point of each line-connected component were recorded.
- (2)
- The connected components were marked line by line. Whether identical components existed as the connected components in the previous line was examined. If such components existed, the label of the overlapping component was assigned to the connected component. If there were overlapping components with multiple connected components, the minimum label was assigned to these connected components. The connected component label of the previous line was written into the equivalent pair and given the minimum label. If there were no overlapping components with the connected component in the previous line, a new label was assigned to the connected component and the scanning continues.
- (3)
- Following the initial scan, minimum labeling of equivalence pairs was conducted. This entails assigning the label minimum of all equivalence paired to all connected components in equivalence pairs until there were no connected equivalence pairs.
2.4. Calculation of Emergence Rate, Canopy Coverage, and Seedling Uniformity
2.5. Evaluation Metrics
3. Results
3.1. Detection of Maize Seedlings
3.2. Quantitative Analysis of Seedling Counting Algorithm
3.3. Evaluation of Seedling Growth
4. Discussion
5. Conclusions
- (1)
- The maize seedling center detection index (MCDI) was constructed to significantly separate the maize seedling center from the background, allowing for accurate identification and extraction of the maize seedling center.
- (2)
- The proposed seedling counting method has effectively solved the problem of leaf adhesion affecting seedling extraction due to the severe leaf cross phenomenon at the late seedling stage. The applicability and robustness of the maize seedling monitoring algorithm have significantly improved.
- (3)
- Based on the quantitative evaluation of maize seedling number, emergence rate, canopy coverage, and uniformity, the overall growth of maize at the seedling stage is effectively monitored. It provides data support for timely and accurate information acquisition for crop precision management. It is helpful to take timely and favorable measures to ensure sufficient, complete, and vigorous seedlings to achieve high yields.
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
UAV | unmanned aerial vehicle |
V(n) stage | nth leaf stage |
MCDI | maize seedling center detection index |
GBDI | green–blue difference index |
ExG | excess green index |
ExR | excess red index |
NGRDI | normalized green minus red difference index |
GLI | green leaf index |
Cg | YCrCb–green difference index |
R | recall rate |
P | precision rate |
OA | overall accuracy |
CE | commission error |
OE | omission error |
F1 | F1-score |
References
- Pierce, F.J.; Nowak, P. Aspects of Precision Agriculture. In Advances in Agronomy; Sparks, D.L., Ed.; Elsevier: Amsterdam, The Netherlands, 1999; pp. 1–85. [Google Scholar]
- Gao, M.; Yang, F.; Wei, H.; Liu, X. Individual Maize Location and Height Estimation in Field from UAV-Borne LiDAR and RGB Images. Remote Sens. 2022, 14, 2292. [Google Scholar] [CrossRef]
- Sweet, D.; Tirado, S.; Springer, N.; Hirsch, C. Opportunities and Challenges in Phenotyping Row Crops Using Drone-based RGB Imaging. Plant Phenome J. 2022, 5, e20044. [Google Scholar] [CrossRef]
- Tao, F.; Zhang, S.; Zhang, Z.; Rotter, R. Temporal and Spatial Changes of Maize Yield Potentials and Yield Gaps in the Past Three Decades in China. Agric. Ecosyst. Environ. 2015, 208, 12–20. [Google Scholar] [CrossRef]
- Liu, M.; Su, W.; Wang, X. Quantitative Evaluation of Maize Emergence Using UAV Imagery and Deep Learning. Remote Sens. 2023, 15, 1979. [Google Scholar] [CrossRef]
- Shirzadifar, A.; Maharlooei, M.; Bajwa, S.; Oduor, P.; Nowatzki, J. Mapping Crop Stand Count and Planting Uniformity Using High Resolution Imagery in a Maize Crop. Biosyst. Eng. 2020, 200, 377–390. [Google Scholar] [CrossRef]
- Feng, A.; Zhou, J.; Vories, E.; Sudduth, K. Evaluation of Cotton Emergence Using UAV-Based Imagery and Deep Learning. Comput. Electron. Agric. 2020, 177, 105711. [Google Scholar] [CrossRef]
- Delavarpour, N.; Koparan, C.; Nowatzki, J.; Bajwa, S.; Sun, X. A Technical Study on UAV Characteristics for Precision Agriculture Applications and Associated Practical Challenges. Remote Sens. 2021, 13, 1204. [Google Scholar] [CrossRef]
- Liu, S.; Yin, D.; Feng, H.; Li, Z.; Xu, X.; Shi, L.; Jin, X. Estimating Maize Seedling Number with UAV RGB Images and Advanced Image Processing Methods. Precis. Agric. 2022, 23, 1604–1632. [Google Scholar] [CrossRef]
- Zhao, L.; Han, Z.; Yang, J.; Qi, H. Single Seed Precise Sowing of Maize Using Computer Simulation. PLoS ONE 2018, 13, e0193750. [Google Scholar] [CrossRef] [Green Version]
- Zhao, J.; Lu, Y.; Tian, H.; Jia, H.; Guo, M. Effects of Straw Returning and Residue Cleaner on the Soil Moisture Content, Soil Temperature, and Maize Emergence Rate in China’s Three Major Maize Producing Areas. Sustainability 2019, 11, 5796. [Google Scholar] [CrossRef] [Green Version]
- Qiao, L.; Gao, D.; Zhao, R.; Tang, W.; An, L.; Li, M.; Sun, H. Improving Estimation of LAI Dynamic by Fusion of Morphological and Vegetation Indices Based on UAV Imagery. Comput. Electron. Agric. 2022, 192, 106603. [Google Scholar] [CrossRef]
- Niu, Y.; Han, W.; Zhang, H.; Zhang, L.; Chen, H. Estimating Fractional Vegetation Cover of Maize under Water Stress from UAV Multispectral Imagery Using Machine Learning Algorithms. Comput. Electron. Agric. 2021, 189, 106414. [Google Scholar] [CrossRef]
- Niu, Y.; Zhang, H.; Han, W.; Zhang, L.; Chen, H. A Fixed-Threshold Method for Estimating Fractional Vegetation Cover of Maize under Different Levels of Water Stress. Remote Sens. 2021, 13, 1009. [Google Scholar] [CrossRef]
- Pereyra, V.; Bastos, L.; de Borja Reis, A.; Melchiori, R.J.; Maltese, N.E.; Appelhans, S.C.; Vara Prasad, P.V.; Wright, Y.; Brokesh, E.; Sharda, A.; et al. Early-Season Plant-to-Plant Spatial Uniformity Can Affect Soybean Yields. Sci. Rep. 2022, 12, 17128. [Google Scholar] [CrossRef]
- Zhao, B.; Zhang, J.; Yang, C.; Zhou, G.; Ding, Y.; Shi, Y.; Zhang, D.; Xie, J.; Liao, Q. Rapeseed Seedling Stand Counting and Seeding Performance Evaluation at Two Early Growth Stages Based on Unmanned Aerial Vehicle Imagery. Front. Plant Sci. 2018, 9, 1362. [Google Scholar] [CrossRef]
- Liu, T.; Li, R.; Jin, X.; Ding, J.; Zhu, X.; Sun, C.; Guo, W. Evaluation of Seed Emergence Uniformity of Mechanically Sown Wheat with UAV RGB Imagery. Remote Sens. 2017, 9, 1241. [Google Scholar] [CrossRef] [Green Version]
- Karayel, D.; Özmerzi, A. Evaluation of Three Depth-Control Components on Seed Placement Accuracy and Emergence for a Precision Planter. Appl. Eng. Agric. 2008, 24, 271–276. [Google Scholar] [CrossRef]
- Vong, C.; Conway, L.; Zhou, J.; Kitchen, N.; Sudduth, K. Early Corn Stand Count of Different Cropping Systems Using UAV-Imagery and Deep Learning. Comput. Electron. Agric. 2021, 186, 106214. [Google Scholar] [CrossRef]
- García-Martínez, H.; Flores-Magdaleno, H.; Khalil-Gardezi, A.; Ascencio-Hernández, R.; Tijerina-Chávez, L.; Vázquez-Peña, M.A.; Mancilla-Villa, O.R. Digital Count of Corn Plants Using Images Taken by Unmanned Aerial Vehicles and cross Correlation of Templates. Agronomy 2020, 10, 469. [Google Scholar] [CrossRef] [Green Version]
- Liu, W.; Zhou, J.; Wang, B.; Costa, M.; Kaeppler, S.; Zhang, Z. IntegrateNet: A Deep Learning Network for Maize Stand Counting from UAV Imagery by Integrating Density and Local Count Maps. IEEE Geosci. Remote Sens. Lett. 2022, 19, 6512605. [Google Scholar] [CrossRef]
- Che, Y.; Wang, Q.; Zhou, L.; Wang, X.; Li, B.; Ma, Y. The Effect of Growth Stage and Plant Counting Accuracy of Maize Inbred Lines on LAI and Biomass Prediction. Precis. Agric. 2022, 23, 2159–2185. [Google Scholar] [CrossRef]
- Barreto, A.; Lottes, P.; Ispizua Yamati, F.; Baumgarten, S.; Wolf, N.; Stachniss, C.; Mahlein, A.; Paulus, S. Automatic UAV-Based Counting of Seedlings in Sugar-Beet Field and Extension to Maize and Strawberry. Comput. Electron. Agric. 2021, 191, 106493. [Google Scholar] [CrossRef]
- Floreano, D.; Wood, R.J. Science, Technology and the Future of Small Autonomous Drones. Nature 2015, 521, 460–466. [Google Scholar] [CrossRef] [Green Version]
- Sun, Y.; Bi, F.; Gao, Y.; Chen, L.; Feng, S. A Multi-Attention UNet for Semantic Segmentation in Remote Sensing Images. Symmetry 2022, 14, 906. [Google Scholar] [CrossRef]
- Maes, W.; Steppe, K. Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision Agriculture. Trends Plant Sci. 2019, 24, 152–164. [Google Scholar] [CrossRef]
- Shuai, G.; Martinez-Feria, R.; Zhang, J.; Li, S.; Basso, B. Capturing Maize Stand Heterogeneity across Yield-Stability Zones Using Unmanned Aerial Vehicles (UAV). Sensors 2019, 19, 4446. [Google Scholar] [CrossRef] [Green Version]
- Yu, Z.; Cao, Z.; Wu, X.; Bai, X.; Qin, Y.; Zhuo, W.; Xiao, Y.; Zhang, X.; Xue, H. Automatic Image-Based Detection Technology for Two Critical Growth Stages of Maize: Emergence and Three-Leaf Stage. Agric. For. Meteorol. 2013, 174–175, 65–84. [Google Scholar] [CrossRef]
- Bai, Y.; Nie, C.; Wang, H.; Cheng, M.; Liu, S.; Yu, X.; Shao, M.; Wang, Z.; Wang, S.; Tuohuti, N.; et al. A Fast and Robust Method for Plant Count in Sunflower and Maize at Different Seedling Stages Using High-Resolution UAV RGB Imagery. Precis. Agric. 2022, 23, 1720–1742. [Google Scholar] [CrossRef]
- Zhou, C.; Yang, G.; Dong, L.; Yang, X.; Xu, B. An Integrated Skeleton Extraction and Pruning Method for Spatial Recognition of Maize Seedlings in MGV and UAV Remote Images. IEEE Trans. Geosci. Remote Sens. 2018, 56, 4618–4632. [Google Scholar] [CrossRef]
- Gndinger, F.; Schmidhalter, U. Digital Counts of Maize Plants by Unmanned Aerial Vehicles (UAVs). Remote Sens. 2017, 9, 544. [Google Scholar] [CrossRef] [Green Version]
- Lin, Y.; Chen, T.; Liu, S.; Cai, Y.; Shi, H.; Zheng, D.; Lan, Y.; Yue, X.; Zhang, L. Quick and Accurate Monitoring Peanut Seedlings Emergence Rate through UAV Video and Deep Learning. Comput. Electron. Agric. 2022, 197, 106938. [Google Scholar] [CrossRef]
- Jin, X.; Liu, S.; Baret, F.; Hemerlé, M.; Comar, A. Estimates of Plant Density of Wheat Crops at Emergence from Very Low Altitude UAV Imagery. Remote Sens. Environ. 2017, 198, 105–114. [Google Scholar] [CrossRef] [Green Version]
- Zhou, C.; Ye, H.; Xu, Z.; Hu, J.; Yang, G. Estimating Maize-Leaf Coverage in Field Conditions by Applying a Machine Learning Algorithm to UAV Remote Sensing Images. Appl. Sci. 2019, 9, 2389. [Google Scholar] [CrossRef] [Green Version]
- Woebbecke, D.; Meyer, G.; Bargen, K.; Mortensen, D. Color Indices for Weed Identification under Various Soil, Residue, and Lighting Conditions. Trans. ASAE 1995, 38, 259–269. [Google Scholar] [CrossRef]
- Otsu, N. A Threshold Selection Method from Gray-Level Histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef] [Green Version]
- Asad, P.; Marroquim, R.; Souza, A. On GPU Connected Components and Properties: A Systematic Evaluation of Connected Component Labeling Algorithms and Their Extension for Property Extraction. IEEE Trans. Image Process. 2019, 28, 17–31. [Google Scholar] [CrossRef] [PubMed]
- Turhal, U. Vegetation Detection Using Vegetation Indices Algorithm Supported by Statistical Machine Learning. Environ. Monit. Assess. 2022, 194, 826. [Google Scholar] [CrossRef]
- Joao, V.; Bilal, S.; Lammert, K.; Henk, K.; Sander, M. Automated crop plant counting from very high-resolution aerial imagery. Precis. Agric. 2020, 21, 106938. [Google Scholar]
- Zheng, Y.; Zhu, Q.; Huang, M.; Guo, Y.; Qin, J. Maize and Weed Classification Using Color Indices with Support Vector Data Description in Outdoor Fields. Comput. Electron. Agric. 2017, 141, 215–222. [Google Scholar] [CrossRef]
- Gitelson, A.; Kaufman, Y.; Stark, R.; Rundquist, D. Novel Algorithms for Remote Estimation of Vegetation Fraction. Remote Sens. Environ. 2002, 80, 76–87. [Google Scholar] [CrossRef] [Green Version]
- Yang, G.; He, Y.; Zhou, Z.; Huang, L.; Li, X.; Yu, Z.; Yang, Y.; Li, Y.; Ye, L.; Feng, X. Field Monitoring of Frac-tional Vegetation Cover Based on UAV Low-altitude Remote Sensing and Machine Learning. In Proceedings of the 2022 10th International Conference on Agro-Geoinformatics, Quebec City, QC, Canada, 11–14 July 2022. [Google Scholar]
- Prasetyo, E.; Adityo, R.; Suciati, N.; Fatichah, C. Mango Leaf Classification with Boundary Moments of Centroid Contour Distances as Shape Features. In Proceedings of the 2018 International Seminar on Intelligent Technology and Its Applications, Bali, Indonesia, 30–31 August 2018. [Google Scholar]
Color Vegetation Indices | Abbreviation | Formula |
---|---|---|
Green–blue difference index [38] | ||
Excess green index [35,39] | ||
Excess red index [40] | ||
Excess green minus excess red index [40] | ||
Normalized green minus red difference index [41] | ||
Green leaf index [42] | ||
YCrCb–green difference index [43] |
Seedling Stage | Test Area | Number of Real Seedlings in Field | Number of Detected Seedlings | Number of Incorrectly Detected Seedlings | Number of Missed Seedlings |
---|---|---|---|---|---|
V3 stage | ROI1 | 221 | 218 | 0 | 3 |
ROI2 | 187 | 186 | 0 | 1 | |
V6 stage | ROI3 | 215 | 213 | 2 | 4 |
ROI4 | 173 | 170 | 1 | 4 |
Seedling Stage | Test Area | R (%) | P (%) | OA (%) | CE (%) | OE (%) | F1 (%) |
---|---|---|---|---|---|---|---|
V3 stage | ROI1 | 98.64 | 100.00 | 98.64 | 0.00 | 1.36 | 99.32 |
ROI2 | 99.47 | 100.00 | 99.47 | 0.00 | 0.53 | 99.73 | |
V6 stage | ROI3 | 98.14 | 99.06 | 99.07 | 0.94 | 1.86 | 98.60 |
ROI4 | 97.69 | 99.41 | 98.27 | 0.59 | 2.31 | 98.54 |
Seedling Stage | Characteristics | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
---|---|---|---|---|---|---|---|---|---|---|---|
V3 | Emergence Rate | 50.30 | 80.06 | 84.23 | 62.20 | 80.95 | 77.14 | 46.67 | 67.14 | 59.52 | 65.47 |
50.00 | 86.31 | 72.32 | 74.70 | 69.05 | 81.19 | 62.14 | 58.33 | 62.38 | 52.38 | ||
68.45 | 88.10 | 78.57 | 67.26 | 69.64 | 71.67 | 50.95 | 61.43 | 52.62 | 58.33 | ||
Mean of 15 plots | 72.14 | 61.82 | |||||||||
Mean of all plots | 66.98 | ||||||||||
CV1 of 15 plots | 16.19 | 15.59 | |||||||||
Mean CV1 of all | 15.89 | ||||||||||
V6 | Emergence Rate | 49.10 | 78.87 | 83.04 | 59.82 | 80.05 | 75.71 | 45.71 | 67.86 | 57.86 | 63.81 |
48.81 | 85.11 | 73.51 | 73.51 | 68.15 | 82.14 | 61.43 | 58.33 | 60.95 | 52.38 | ||
69.34 | 86.01 | 75.89 | 66.37 | 68.15 | 70.95 | 50.24 | 61.90 | 51.90 | 56.43 | ||
Mean of 15 plots | 71.05 | 61.17 | |||||||||
Mean of all plots | 66.11 | ||||||||||
CV2 of 15 plots | 16.34 | 16.13 | |||||||||
Mean CV2 of all | 16.23 |
Seedling Stage | Characteristics | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
---|---|---|---|---|---|---|---|---|---|---|---|
V3 | Canopy Cover | 2.07 | 2.44 | 2.35 | 1.95 | 2.50 | 2.70 | 2.40 | 2.58 | 2.10 | 2.55 |
1.66 | 2.52 | 2.47 | 2.34 | 2.26 | 2.75 | 2.56 | 2.12 | 2.35 | 2.01 | ||
1.97 | 2.29 | 2.10 | 2.13 | 2.23 | 2.60 | 2.24 | 2.44 | 2.05 | 1.98 | ||
Mean of 15 plots | 2.22 | 2.36 | |||||||||
Mean of all plots | 2.29 | ||||||||||
CV1 of 15 plots | 10.85 | 11.09 | |||||||||
Mean CV1 of all | 10.97 | ||||||||||
V6 | Canopy Cover | 27.50 | 30.68 | 34.82 | 31.78 | 34.58 | 35.84 | 34.12 | 34.41 | 35.94 | 35.23 |
25.51 | 32.16 | 33.47 | 32.35 | 31.64 | 33.67 | 32.33 | 32.85 | 35.9 | 35.21 | ||
32.14 | 34.11 | 32.43 | 29.67 | 29.48 | 31.24 | 27.74 | 29.29 | 29.38 | 30.81 | ||
Mean of 15 plots | 31.49 | 32.93 | |||||||||
Mean of all plots | 32.21 | ||||||||||
CV2 of 15 plots | 8.22 | 8.18 | |||||||||
Mean CV2 of all | 8.20 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Gao, M.; Yang, F.; Wei, H.; Liu, X. Automatic Monitoring of Maize Seedling Growth Using Unmanned Aerial Vehicle-Based RGB Imagery. Remote Sens. 2023, 15, 3671. https://doi.org/10.3390/rs15143671
Gao M, Yang F, Wei H, Liu X. Automatic Monitoring of Maize Seedling Growth Using Unmanned Aerial Vehicle-Based RGB Imagery. Remote Sensing. 2023; 15(14):3671. https://doi.org/10.3390/rs15143671
Chicago/Turabian StyleGao, Min, Fengbao Yang, Hong Wei, and Xiaoxia Liu. 2023. "Automatic Monitoring of Maize Seedling Growth Using Unmanned Aerial Vehicle-Based RGB Imagery" Remote Sensing 15, no. 14: 3671. https://doi.org/10.3390/rs15143671