(video) [3D-DLAD-v4] Collaborative and Adversarial 3D Perception for Autonomous Driving, Yiming Li

3D-DLAD-v4 Workshop at IV2022
Speaker : Yiming Li, PhD Student, New York University
Abstract : Robust and reliable perception systems serve as the “eyes” of autonomous vehicles. LiDAR is a widely applied perception sensor in autonomous vehicles for capturing 3D geometry information of the environment.

However, LiDAR-based perception faces many challenges such as data sparsity, occlusions, and motion distortion. In this talk, I will show how we design novel 3D deep learning algorithms from two aspects, collaborative and adversarial, in order to improve the robustness of LiDAR-based 3D perception. For effective and efficient collaborative perception, we propose DiscoNet. It uses a dynamic directed graph with matrix-valued edge weight for an ego-vehicle to adaptively retrieve the most important complementary information from its neighboring vehicles, which could improve its own perception performance and robustness.

Besides collaborative perception, we also study the adversarial robustness of LiDAR-based perception, and reveal an often-overlooked vulnerability that lies in the LiDAR motion correction process. We show that spoofing of a vehicle’s trajectory estimation with small adversarial perturbations can jeopardize LiDAR perception. We hope our collaborative and adversarial 3D perception research can help improve the robustness and safety of autonomous driving systems.


What do you think?

162 Points
Upvote Downvote

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

GIPHY App Key not set. Please check settings

(video) Intro. of RS-LiDAR-M1

(video) Third Wave Automation and Ouster power the future of Material Handling