Robust Sensor Fusion Algorithms Against Voice Command Attacks in Autonomous Vehicles

Jiwei Guan, Xi Zheng, Chen Wang, Yipeng Zhou, Alireza Jolfaei

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With recent advances in autonomous driving, voice control systems have become increasingly adopted as human-vehicle interaction methods. This technology enables drivers to use voice commands to control the vehicle and will be soon available in Advanced Driver Assistance Systems (ADAS). Prior work has shown that Siri, Alexa and Cortana, are highly vulnerable to inaudible command attacks. This could be extended to ADAS in real-world applications and such an inaudible command threat is difficult to detect due to microphone nonlinearities. In this paper, we aim to develop a more practical solution by using camera views to defend against inaudible command attacks where ADAS are capable of detecting their environment via multi-sensors. To this end, we propose a novel multimodal deep learning classification system to defend against inaudible command attacks. Our experimental results confirm the feasibility of the proposed defense methods and the best classification accuracy reaches 89.2%. Code is available at https://github.com/ITSEG-MQ/Sensor-Fusion-Against-VoiceCommand-Attacks.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE 20th International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2021
EditorsLiang Zhao, Neeraj Kumar, Robert C. Hsu, Deqing Zou
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages895-902
Number of pages8
ISBN (Electronic)9781665416580
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event20th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2021 - Shenyang, China
Duration: 20 Oct 202122 Oct 2021

Publication series

NameProceedings - 2021 IEEE 20th International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2021

Conference

Conference20th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2021
Country/TerritoryChina
CityShenyang
Period20/10/2122/10/21

Keywords

  • Visualization
  • Ultrasonic imaging
  • Virtual assistants
  • Sensor fusion
  • Cameras
  • Reliability engineering
  • Robustness

Fingerprint

Dive into the research topics of 'Robust Sensor Fusion Algorithms Against Voice Command Attacks in Autonomous Vehicles'. Together they form a unique fingerprint.

Cite this