Obstacle detection method of lawn mowing robot based on multi-sensor fusion
LI Zhongli1, MA Lixiang2, HAN Chong2, WANG Shuai2
（1. Henan Provincial Key Laboratory of Automobile Energy Saving and New Energy, Luoyang， Henan 471003, China; 2. College of Vehicle and Traffic Engineering， Henan University of Science and Technology, Luoyang， Henan 471003, China)
Abstract：To improve the environmental perception ability of lawn mowing robot during autonomous operation, the obstacle detection method based on the fusion of cameras and low-cost solid-state lidar was proposed. Based on the improved DBSCAN clustering algorithm, the KANN-DBSCAN algorithm was proposed to adaptively determine the clustering parameters. By the algorithm, the 3D point cloud collected by the solid-state lidar was clustered and analyzed, and the obstacle point cloud was obtained and passed through the camera. The results of joint calibration with solid-state lidar were projected onto 2D. The obstacle sample training was completed based on the single short multibox detector（SSD） target detection network, and the image information was detected and recognized to complete the camera-based obstacle detection. To avoid the limited visual or radar detection performance due to the insufficient light or the difficulty of sparse clustering of long-distance radar point clouds, the target-level information fusion strategy with complementary advantages was proposed. The experimental results show that based on the fusion of the detection results of the two sensors, the proposed information fusion strategy can be used under the change of environmental conditions. When the detection performance of single sensor is limited, the missed detection and false detection of environmental perception can be effectively avoided， and the comprehensive detection rate of obstacles after information fusion is about 87.5%, which is significantly improved compared to single sensor and makes the environmental perception information more comprehensive and reliable.
李忠利1, 马理想2, 韩冲2, 王帅2. 多传感器融合的割草机器人障碍物检测方法[J]. 江苏大学学报（自然科学版）, 2024, 45(2): 160-166.
LI Zhongli1, MA Lixiang2, HAN Chong2, WANG Shuai2. Obstacle detection method of lawn mowing robot based on multi-sensor fusion[J]. Journal of Jiangsu University(Natural Science Eidtion)
, 2024, 45(2): 160-166.
CHENG K Y,ZHU X S,PEI Y S,et al.Research progress of agricultural automatic machinery obstacle detection[J].Journal of Jiangsu University(Natural Science Edition),2023,44(4)：415-425.(in Chinses)
［3］
OH S I,KANG H B.Object detection and classification by decision-level fusion for intelligent vehicle systems[J].Sensors,2017,17(12)：207-228.
［4］
WANG H,LOU X Y, CAI Y F, et al. Real-time vehicle detection algorithm based on vision and lidar point cloud fusion[J].Journal of Sensors,2019,2019(3)：1-9.
DENG Q T, LI X..Vehicle detection algorithm based on multi-feature fusion[J].Sensors and Microsystems,2020,39(6)：131-134. ( in Chinese)
［7］
翟文轩.基于激光雷达与相机融合的车辆检测技术研究[D].长沙：湖南大学,2020.
［8］
娄新雨.基于多传感器融合的智能车道路障碍物检测[D].镇江：江苏大学,2020.
［9］
DIETERLE T, PARTICKE F, PATINO-STUDENCKI L,et al. Sensor data fusion of LIDAR with stereo RGB-D camera for object tracking[C]∥Proceedings of 2017 IEEE Sensors,2017：1-3.
［10］
ZHANG Z Y. Flexible camera calibration by viewing a plane from unknown orientations[C]∥IEEE International Conference on Computer Vision, 1999:666-673.
ZHANG Q C, HE X C,YAO S,et al. Research on the fusion technology of camera and lidar based on ROS intelligent mobile robot[J]. China Test, 2021,47(12):120-123.(in Chinese)
XI W H, PEI X F,GUO X X,et al. Target detection algorithm for intelligent vehicle based on solid-state lidar [J].Journal of Wuhan University of Technology,2022,44(2)：90-95.(in Chinese)
WU C,LI X J.Autonomous navigation method of orchard robot based on single laser[J]. Journal of Jiangsu University(Natural Science Edition),2023,44(5)：530-539.(in Chinses)
LI W J,YAN S Q,JIANG Y, et al.Research on method of self-adaptive determination of DBSCAN algorithm parameters[J].Computer Engineering and Applications,2019,55(5)：1-7,148.(in Chinese)
TANG C, LING Y S, ZHENG K D, et al. Object detection method of multi-view SSD based on deep learning[J]. Infrared and Laser Engineering,2018,47(1)：290-298.(in Chinese)
