Individual plant extraction and counting from field images based on leaf matching
1. College of Mathematics and Informatics, South China Agricultural University, Guangzhou, Guangdong 510642, China; 2. Guangxi Key Laboratory of Biology for Crop Diseases and Insect Pests/Institute of Plant Protection, Guangxi Academy of Agricultural Sciences, Nanning, Guangxi 530007, China
Abstract:A method was constructed to extract individual plant image from the continuouslycollected images. The leaf surface region segmentation was obtained, and the individual plant image was separated based on leaf surface image by leaf distance. The two consecutive adjacent images were stitched together, and the newlyformed images were transformed and stitched with empty images to produce individual plant image for determining the centroid. The distance between the centroid of all stitched images in the previous image and the centroid of all the stitched images in the subsequent image was compared. The distance threshold method was used to identify whether the two images were the images of the same crop. Transfer closure was applied for obtaining the plant image set of each crop in multiple continuous images, and the image closest to the center was selected as the best image. Five crops were used to verify the proposed method. The results show that the accuracy of plant number reaches 100%. The proposed method can successfully and precisely extract individual plant image with high computational efficiency.
ZHAO B Q, DING Y C, CAI X B, et al. Seedlings number identification of rape planter based on low altitude unmanned aerial vehicles remote sensing technology[J]. Transactions of the CSAE, 2017, 33(19): 115-123. (in Chinese)
LIU S B, YANG G J, ZHOU C Q, et al. Extraction of maize seedling number information based on UAV imagery[J]. Transactions of the CSAE, 2018, 34(22): 69-77. (in Chinese)
[3]
FRIEDERIKE G, SCHMIDHALTER U. Digital counts of maize plants by unmanned aerial vehicles (UAVs)[J]. Remote Sensing,2017,9(6):544-559.
[4]
JIN X L, LIU S Y, BARET F,et al. Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery[J]. Remote Sensing of Environment,2017,198:105-114.
JIA H L, WANG G, GUO M Z, et al. Methods and experiments of obtaining corn population based on machine vision[J]. Transactions of the CSAE, 2015, 31(3): 215-220. (in Chinese)
CHEN Y S, GENG C X, WANG Y, et al. Center line extraction of paddy seedling row based on segmented vertical projection[J]. Journal of Jiangsu University(Nature Science Edition), 2022, 43(3): 289-295. (in Chinese)
[7]
TAN P, ZENG G, WANG J D, et al. Imagebased tree modeling[J]. ACM Transactions on Graphics,2007,26(3):87-93.
[8]
QUAN L, TAN P, ZENG G, et al. Imagebased plant modeling[J]. ACM Transactions on Graphics,2006,25(3):772-778.
[9]
GAUTIER V, OLIVIER L, PAULHUNRY C. Leaf segmentation and tracking in arabidopsis thaliana combined to an organscale plant model for genotypic differentiation\[J\]. Frontiers in Plant Science, 2017, 7:1-14.
[10]
JEANMICHEL P, CHRISTIAN K. 3D Histogrambased segmentation and leaf detection for rosette plants[C]∥ECCV, 2015:61-74.
LI J H, LIN L J, TIAN K, et al. Detection of leaf diseases of balsam pear in the field based on improved Faster RCNN[J]. Transactions of the CSAE, 2020, 36(12): 179-185. (in Chinese)
WANG C S, ZHOU J, WU H R, et al. Identification of vegetable leaf diseases based on improved Multiscale ResNet[J]. Transactions of the CSAE, 2020, 36(20): 209-217. (in Chinese)
[13]
BRUNO B M, JONATAN P M O, MAURO S A,et al. BioLeaf: a professional mobile application to measure foliar damage caused by insect herbivory[J]. Computers and Electronics in Agriculture, 2016, 129: 44-55.
ZHAO J H, LUO X W, ZHOU Z Y. Image segmentation method for sugarcane diseases based on color and shape features[J]. Transactions of the CSAM, 2008, 39(9): 100-103,133. (in Chinese)
WANG S Z, HE D J, LI W, et al. Plant leaf disease recognition based on kernel Kmeans clustering algorithm[J]. Transactions of the CSAM, 2009, 40(3):152-155. (in Chinese)
[16]
ZHANG L K, WECKLER P, WANG N, et al. Individual leaf identification from horticultural crop images based on the leaf skeleton[J]. Computers and Electronics in Agriculture, 2016, 127(1):184-196.
[17]
MATTHEW B, DAVID G L. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision, 2007,74(1): 59-73.
YAO X T, WANG Z Y, SHI W, et al. Fast stitching algorithm based on perceptual HASH and scale invariant feature transformation[J]. Journal of Sichuan University (Natural Science Edition), 2021, 58(3): 89-96. (in Chinese)