Hidden Trigger Backdoor Attacks

Author/Creator ORCID

Date

2019-12-21

Department

Program

Citation of Original Publication

Saha, Aniruddha; Subramanya, Akshayvarun; Pirsiavash, Hamed; Hidden Trigger Backdoor Attacks; Computer Vision and Pattern Recognition (2019); Proceedings of the AAAI Conference on Artificial Intelligence; https://aaai.org/ojs/index.php/AAAI/article/view/6871

Rights

This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
© 2019, Association for the Advancement of Artificial Intelligence

Abstract

With the success of deep learning algorithms in various domains, studying adversarial attacks to secure deep models in real world applications has become an important research topic. Backdoor attacks are a form of adversarial attacks on deep networks where the attacker provides poisoned data to the victim to train the model with, and then activates the attack by showing a specific small trigger pattern at the test time. Most state-of-the-art backdoor attacks either provide mislabeled poisoning data that is possible to identify by visual inspection, reveal the trigger in the poisoned data, or use noise to hide the trigger. We propose a novel form of backdoor attack where poisoned data look natural with correct labels and also more importantly, the attacker hides the trigger in the poisoned data and keeps the trigger secret until the test time. We perform an extensive study on various image classification settings and show that our attack can fool the model by pasting the trigger at random locations on unseen images although the model performs well on clean data. We also show that our proposed attack cannot be easily defended using a state-of-the-art defense algorithm for backdoor attacks.