Robust vehicle and surrounding environment dynamic analysis for assistive driving using visual-inertial measurements

Loading...
Thumbnail Image
Authors
Zhang, Yinlong
Liang, Wei
He, Hongsheng
Tan, Jindong
Issue Date
2018-12-24
Type
Article
Language
en_US
Keywords
Vehicle and Surrounding Environment Dynamic Analysis (VSEDA) , Assistive driving , Monocular camera , Inertial Measurement Unit (IMU) , Multi-sensor fusion , Complex road conditions
Research Projects
Organizational Units
Journal Issue
Alternative Title
Abstract

Vehicle and surrounding environment dynamic analysis (VSEDA) is an indispensable component of modern assistive drivings. A robust and accurate VSEDA could ensure the driving system reliability in presence of highly dynamic environments. This paper proposes a novel VSEDA framework by fusing the measurements from an inertial sensor and a monocular camera. Compared to traditional visual-inertial based assistive driving methods, the proposed approach can analyze both the vehicle dynamics and the surrounding environment. Even in the scenario that moving objects occupy a majority area of the scene captured in the image, the proposed method can still robustly analyze the surrounding environment by identifying the static inliers and dynamic inliers, which lie on stationary objects and moving objects, respectively. The theoretical framework consists of three steps. Firstly, the vehicle nonholonomic constraint is applied to pairwise feature matching. For vehicle dynamic analysis, the static inliers are selected by choosing the features with their histogram bins consistent with inertial orientations. Secondly, for the surrounding environment dynamic analysis, the dynamic inliers are matched through histogram voting, together with the developed part-based vehicle detection model that can segment and match the vehicle regions from the background in image pairs. Finally, both the vehicle dynamics and surrounding environments are analyzed with static and dynamic inliers respectively. The proposed method has been evaluated on the challenging datasets, part of which were collected during rush hours in downtown areas. The experimental results prove the effectiveness and accuracy of the proposed VSEDA.

Description
Published in IEEEAccess, Multidisciplinary, Rapid review, Open access journal
Citation
Y. Zhang, W. Liang, H. He and J. Tan, "Robust Vehicle and Surrounding Environment Dynamic Analysis for Assistive Driving Using Visual-Inertial Measurements," in IEEE Access
Publisher
IEEE
License
Journal
Volume
Issue
PubMed ID
DOI
ISSN
2169-3536
EISSN