Identification of early crop row for drillcrops based on reverse perspective transformation
1. Beijing Research Center for Intelligent Equipment Technology in Agricultural, Beijing 100097, China; 2. National Engineering Research Center Information Technology in Agricultural, Beijing 100097, China; 3. School of Agricultural Engineering and Food Science, Shandong University of Technology, Zibo, Shandong 255000, China; 4. Xinjiang Agriculture Academy, Shihezi, Xinjiang 832000, China
Abstract:To meet the requirements of field working along the drill crops, a new crop row detection method was proposed. The camera was installed in front of the tractor to obtain the relative space position of farm implements or crop rows. To improve the recognition accuracy of crop rows, the inverse perspective transformation algorithm was used to eliminate the image geometric distortion, and the ossification algorithm was used to obtain the intersection of the skeleton lines of crop rows in the reverse perspective image. The bottom area of the perspective image was selected for vertical projection, and the edge points of the crop rows in the perspective image were obtained. The inverse perspective transformation was carried out, and the intersection points of skeleton lines were divided in the inverse perspective image according to the edge points. The results of identifying and fitting 300 wheat rows with different growth conditions show that the average error of crop row fitting is 2.136 7 degree with standard deviation of 1.024 3 degree and average time consuming of 0.364 7 s, which can meet the real-time requirements.
赵学观1,2, 马伟1,2, 高原源1, 臧云飞3, 何义川4, 王秀1,2. 基于逆透视变换的条播作物早期作物行识别[J]. 江苏大学学报(自然科学版), 2019, 40(6): 668-675.
ZHAO Xueguan1,2, MA Wei1,2, GAO Yuanyuan1, ZANG Yunfei3, HE Yichuan4, WANG Xiu1,2. Identification of early crop row for drillcrops based on reverse perspective transformation[J]. Journal of Jiangsu University(Natural Science Eidtion)
, 2019, 40(6): 668-675.
MOUSAZADEH H. A technical review on navigation systems of agricultural autonomous off-road vehicles[J]. Journal of Terramechanics, 2013, 50(3): 211-232.
[2]
LI G N, TAN Q C, SUN Q C, et al. Normal strain measurement by machine vision[J]. Measurement, 2014, 50(4): 106-114.
[3]
GONGAL A, SILWAL A, AMATYA S, et al. Apple crop-load estimation with over-the-row machine vision system[J].Computers and Electronics in Agriculture, 2016, 120: 26-35.
[4]
GUERRERO J M, GUIJARRO M, MONTALVO M, et al. Automatic expert system based on images for accuracy crop row detection in maize fields [J].Expert Systems with Applications, 2013,40(2): 656-664.
SONG Y, LIU Y B, LIU L, et al. Extraction method of navigation baseline of corn roots based on machine vision[J].Transactions of the CSAM,2017,48(2):38-44.(in Chinese)
ZHAI Z Q, ZHU Z X, DU Y F, et al. Method for detecting crop rows based on binocular vision with Census transformation[J].Transactions of the CSAE, 2016,32(11):205-213.(in Chinese)
HE J, MENG Q K, ZHANG M, et al. Crop baseline extraction method for off-road vehicle based on boundary detection and scan-filter[J]. Transactions of the CS-AM, 2014,45(S1):265-270. (in Chinese)
[8]
SGAARD H T, OLSEN H J. Determination of crop rows by image analysis without segmentation[J]. Computers and Electronics in Agriculture, 2003, 38(2):141-158.
MENG Q K, HE J, CHOU R C, et al. Crop recognition and navigation line detection in natural environment based on machine vision[J]. 2014,34(7):180-186.(in Chinese)
[10]
ROMEO J, PAJARES G, MONTALVO M, et al. Crop row detection in maize fields inspired on the human vi-sual perception[J].The Scientific World Journal, doi:10.1100/2012/484390.
MENG Q K, ZHANG M, CHOU R C, et al. Navigation line detection for farm machinery based on improved genetic algorithm[J]. Transactions of the CSAM, 2014,45(10):39-46.(in Chinese)
JI C Y, SHEN Z Y, GU B X, et al. Obstacle detection based on point clouds in application of agricultural navigation[J].Transactions of the CSAE, 2015,31(7): 173-179.(in Chinese)
DIAO Z H, WU B B, WU Y Y, et al. Skeleton extraction algorithm of corn crop rows based on maximum square[J]. Transactions of the CSAE,2015,31(23):168-172.(in Chinese)
DIAO Z H, ZHAO M Z, SONG Y M, et al. Crop line recognition algorithm and realization in precision pesticide system based on machine vision[J]. Transactions of the CSAE,2015,31(7):47-52.(in Chinese)
[15]
RAMESH K N, CHANDRIKA N, OMKAR S N, et al. Detection of rows in agricultural crop images acquired by remote sensing from a UAV[J]. International Journal of Image, Graphics and Signal Processing, 2016,8(11): 25-31.
JIANG G Q, YANG X Y, WANG Z H, et al. Crop rows detection based on image characteristic point and particle swarm optimization-clustering algorithm[J]. Tran-sactions of the CSAE,2017,33(11):165-170.(in Chinese)
[17]
GUERRERO J M, GUIJARRO M, MONTALVO M,et al.Automatic expert system based on images for accuracy crop row detection in maize fields[J]. Expert Systems with Applications, 2013, 40 (2):656-664.
CHEN J, JIANG G Q, DU S F, et al. Crop rowsdetection based on parallel characteristic of crop rows usingvisual navigation.[J]. Transactions of the CSAE, 2009,25(12): 107-113. (in Chinese)
LIU H T, JIANG R Y, HU W, et al. Inverse perspective mapping of general road based on vertical road mo-deling[J]. Journal of Shanghai Jiao Tong University,2012,46(11):1770-1773.(in Chinese)
WANG C,HE Y. Vehicle queue length detection based on inverse perspective mapping and its hardware implementation[J]. Computer Measurement & Control, 2016,24(8): 28-31. (in Chinese)
CAO Y,FENG Y,LEI B,et al. Error analysis and accuracy verification of inverse perspective mapping formula [J]. Acta Photoptica Sinica,2011,40(12): 1833-1838. (in Chinese)
[23]
SAINZ-COSTA N, RIBEIRO A, XAVIER P, et al. Mapping wide row crops with video sequences acquired from a tractor moving at treatment speed[J]. Sensors, 2011, 11(7): 7095-7109.
LI T, QIAO J, LIU Y T. Design and implementation of auto-guided smart car based on monocular vision[J]. Journal of Chongqing University of Technology (Natural Science), 2016,30(10):16-22. (in Chinese)