|
|
|
Abstract To solve the inevitable shortcomings of single sensor environmental perception system, the LiDAR and camera were fused to combine the advantages of the two sensors and form complementarity for improving the environmental perception capability of unmanned vehicles. The fusion technology of LiDAR and camera was investigated and applied for the target recognition at urban intersections. Combining the search theory of Flood Fill algorithm with the tangent theory of spectral clustering algorithm, and considering the Euclidean distance and spatial distribution characteristics between point clouds, the laser radar target detection method was investigated. The target recognition method based on the fusion of LiDAR radar and camera was proposed, and the traditional PnP solving principle was analyzed. The pose transformation relationship was solved based on the plane normal alignment, and the genetic algorithm was introduced to optimize the solution results. The fusion results of LiDAR and camera were simulated and verified by the autonomous driving simulation software. The results show that by the proposed fusion method of LiDAR and camera, the vehicle targets at urban intersections can be accurately recognized, and the unmanned vehicles can perceive targets within 360° range. This can ensure the safety of unmanned vehicles and improve the environmental understanding ability.
|
|
|
|
|
|
| ［1］ |
贾文博.基于雷达与视觉融合的车辆检测方法研究[D].大连：大连理工大学,2021.
|
| ［2］ |
徐文轩,李伟.无人驾驶汽车环境感知与定位技术[J].汽车科技,2021(6):53-60，52.
|
|
XU W X, LI W.Environmental perception and location technology of driverless vehicles[J]. Automobile Science & Technology,2021(6):53-60，52. (in Chinese)
|
| ［3］ |
曾帅康.基于ROS的低速无人车环境感知与控制方法研究[D]. 北京：北京交通大学,2021.
|
| ［4］ |
李研芳,黄影平. 基于激光雷达和相机融合的目标检测[J]. 电子测量技术，2021, 44(5):112-117.
|
|
LI Y F, HUANG Y P. Target detection based on the fusion of lidar and camera[J]. Electronic Measurement Technology，2021, 44(5):112-117.(in Chinese)
|
| ［5］ |
杨鑫,刘威,林辉. 面向高级辅助驾驶雷达和视觉传感器信息融合算法的研究[J]. 汽车实用技术, 2018(1):37-40.
|
|
YANG X, LIU W, LIN H. Research of radar and vision sensors data fusion algorithm applied in advanced driverassistance systems[J]. Automobile Applied Technology, 2018(1):37-40.(in Chinese)
|
| ［6］ |
郑少武,李巍华,胡坚耀. 基于激光点云与图像信息融合的交通环境车辆检测[J]. 仪器仪表学报, 2019, 40(12):143-151.
|
|
ZHENG S W, LI W H, HU J Y. Vehicle detection in the traffic environment based on the fusion of laserpoint cloud and image information[J]. Chinese Journal of Scientific Instrument, 2019, 40(12):143-151.(in Chinese)
|
| ［7］ |
陈昆. 基于双目视觉和激光雷达融合的道路环境感知技术[D]. 杭州：浙江大学, 2020.
|
| ［8］ |
梁晨晨,田金鹏,宋春林. 基于雷达和摄像头传感器融合的辅助驾驶目标检测算法[J].信息技术与信息化, 2021(12):5-9.
|
|
LIANG C C, TIAN J P, SONG C L. Aided driving target detection algorithm based on radar and camera sensor fusion[J]. Information Technology & Informatization, 2021(12):5-9.(in Chinese)
|
| ［9］ |
圣园园. 链篦机台车侧板裂缝检测方法研究[D]. 包头：内蒙古科技大学, 2021.
|
| ［10］ |
杨迪,蔡怡然,王鹏,等. 基于改进谱聚类算法的交通区域划分方法[J]. 计算机工程与设计, 2021,42(9):2478-2484.
|
|
YANG D, CAI Y R, WANG P, et al. Traffic regional division method based on improved spectral clustering algorithm[J]. Computer Engineering and Design, 2021, 42(9):2478-2484.(in Chinese)
|
| ［11］ |
REDMON J, FARHADI A. YOLO9000: better, faster, stronger[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway，USA:IEEE,2017:7263-7271.
|
| ［12］ |
MOUSAVIAN A, ANGUELOV D, FLYNN J, et al. 3D bounding box estimation using deep learning and geometry[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway，USA:IEEE,2017:7074-7082.
|
| ［13］ |
潘浩然. 基于改进损失函数的YOLOv3的人脸检测[D]. 南昌：南昌大学, 2020.
|
| ［14］ |
宫铭钱. 基于激光雷达和相机信息融合的车辆识别与跟踪研究[D]. 重庆：西南大学, 2021.
|
| ［15］ |
MOHAMMADI A, ASADI H, MOHAMED S, et al. OpenGA, a C++ genetic algorithm library[C]∥2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Piscataway，USA:IEEE,2017:2051-2056.
|
|
|
