Work

Where Classification Fails, Interpretation Rises

Year: 2017
Type: preprint
Abstract: An intriguing property of deep neural networks is their inherent vulnerability to adversarial inputs, which significantly hinders their application in security-critical domains. Most existing detection methods attempt to use carefully engineered patterns to distinguish adversarial inputs from their genuine counterparts, which however can often be circumvented by adaptive adversaries. In this work, we take a completely different route by leveraging the definition of adversarial inputs: while deceiving for deep neural networks, they are barely discernible for human visions. Building upon recent advances in interpretable models, we construct a new detection framework that contrasts an input's interpretation against its classification. We validate the efficacy of this framework through extensive experiments using benchmark datasets and attacks. We believe that this work opens a new direction for designing adversarial input detection methods.
Authors: Nguyen, Chanh, Georgiev, Georgi, Ji, Yujie, Wang, Ting
Institution: Lehigh University
Language: English
Open Access status: green
OpenAlex ID: W2772776568
Cites: 16
Cited by:
Related to: 10