Explainable and Fair Deep Learning Models for Automated Decision-Making in High-Stakes Financial and Healthcare Systems: https://doi.org/10.5281/zenodo.19121145
Year: 2026
Type: article
Abstract: The deployment of deep learning models in high-stakes domains such as healthcare diagnostics, credit scoring, insurance underwriting, and fraud detection has raised critical concerns regarding transparency, trustworthiness, and equity. This review examines the dual imperatives of explainable artificial intelligence (XAI) and algorithmic fairness to mitigate the “black-box” limitations of neural networks in automated decision-making systems. Key XAI techniques post-hoc methods (SHAP, LIME, Integrated Gradients), attention visualization, counterfactual explanations, and inherently interpretable architectures (concept bottleneck models, prototype-based networks) are evaluated for their ability to provide human-understandable rationales without compromising predictive performance. Fairness frameworks address group and individual fairness through pre-processing (re-weighting, adversarial debiasing), in-processing (constraint optimization), and post-processing (threshold adjustment) strategies, with particular attention to protected attributes (race, gender, age) and proxy variables. Application-specific insights highlight successes in medical imaging (explainable CNNs for chest X-ray interpretation), financial risk models (fair GNNs for fraud detection), and claims processing. Regulatory landscapes (EU AI Act, US NIST AI Risk Management Framework) and emerging standards (FAIR principles, ISO/IEC 42001) are discussed alongside persistent challenges: trade-offs between accuracy, explainability, and fairness; scalability of explanations for large models; and robustness against adversarial attacks on interpretability. The synthesis underscores the necessity of hybrid human-AI governance models to ensure accountable, equitable, and clinically/financially reliable automated decisions.
Author: Amjad Ali
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Keywords: explainable AI, algorithmic fairness, automated decision-making, clinical decision support, credit scoring, insurance underwriting, fraud detection, SHAP, lime, integrated gradients, attention visualization, counterfactual explanations, concept bottleneck models, group fairness, individual fairness, adversarial debiasing, threshold adjustment, chest X-ray interpretation, graph neural networks, AI regulation, EU AI Act, NIST AI Risk Management Framework, FAIR principles, ISO/IEC 42001, human-AI governance
SDG: Reduced inequalities
Open Access status: hybrid
OpenAlex ID: W7220828580
