Year: 2022
Type: article
Abstract: We study rare-event simulation for a class of problems where the target hitting sets of interest are defined via modern machine learning tools such as neural networks and random forests. This problem is motivated from fast emerging studies on the safety evaluation of intelligent systems, robustness quantification of learning models, and other potential applications to large-scale simulation in which machine learning tools can be used to approximate complex rare-event set boundaries. We investigate an importance sampling scheme that integrates the dominating point machinery in large deviations and sequential mixed integer programming to locate the underlying dominating points. Our approach works for a range of neural network architectures including fully connected layers, rectified linear units, normalization, pooling and convolutional layers, and random forests built from standard decision trees. We provide efficiency guarantees and numerical demonstration of our approach using a classification model in the UCI Machine Learning Repository.
DOI: 10.1145/3519385
Authors: Yuanlu Bai, Zhiyuan Huang, Henry Lam, Ding Zhao
Institutions: Columbia University, Tongji University, Carnegie Mellon University
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
Awards: S&AS:FND:COLLAB:Unsupervised Rare Event Learning - With Applications on Autonomous Vehicles, S&AS:FND:COLLAB:Unsupervised Rare Event Learning - With Applications on Autonomous Vehicles, G3387330441, CAREER: Optimization-based Quantification of Statistical Uncertainty in Stochastic and Simulation Analysis, CAREER: Optimization-based Quantification of Statistical Uncertainty in Stochastic and Simulation Analysis, G6671297155
OpenAlex ID: W3092003702
