Knowledge Distillation for Input-Driven Switching State-Space Models for Clinical Decision Making
Year: 2026
Type: dissertation
Abstract: We propose a framework for knowledge distillation of deep learning models into interpretable probabilistic graphical models (PGMs) with input-driven dynamics for sequential treatment decision making in healthcare in order to model evolution of patient health states in response to therapeutic actions in a clinical setting. While deep learning models like LSTMs achieve superior predictive performance in healthcare applications, their black-box nature limits clinical adoption. Conversely, interpretable models such as autoregressive Hidden Markov Models (AR-HMMs) offer transparency but do not necessarily learn representations that are predictive of patient outcomes for informed treatment decision making. To bridge this gap, we extend recent work on Constrained Variational Inference Knowledge Distillation to incorporate input-driven dynamics, allowing models to account for the effect of treatments (inputs) on patient state evolution over time. Our preliminary results on the MIMIC-IV dataset show promise for this approach, with knowledge-distilled AR-HMMs performing significantly better than baseline models while maintaining interpretability. This work lays methodological groundwork for future clinical decision support research by enabling more accurate and interpretable modeling of treatment-dependent patient dynamics.
Author: Sheriff, Fareed
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7201915255
