Work

The use of the EM algorithm for regularization problems in high-dimensional linear mixed-effects models

Year: 2025

Type: article

Abstract: The expectation-maximization (EM) algorithm is a popular tool for maximum likelihood estimation, but its use in high-dimensional regularization problems in linear mixed-effects models has been limited. In this article, we introduce the EMLMLasso algorithm, which combines the EM algorithm with the popular and efficient R package glmnet for Lasso variable selection of fixed effects in linear mixed-effects models and allows for automatic selection of the tuning parameter. A comprehensive performance evaluation is conducted, comparing the proposed EMLMLasso algorithm against two existing algorithms implemented in the R packages glmmLasso and splmm . In both simulated and real-world applications analyzed, our algorithm showed robustness and effectiveness in variable selection, including cases where the number of predictors ( p ) is greater than the number of independent observations ( n ) . In most evaluated scenarios, the EMLMLasso algorithm consistently outperformed both glmmLasso and splmm . The proposed method is quite general and simple to implement, allowing for extensions based on ridge and elastic net penalties in linear mixed-effects models.

Source: Statistical Methods in Medical Research

DOI: 10.1177/09622802251399913

Authors: Daniela CR Oliveira, Fernanda L Schumacher, Victor H Lachos

Institutions: Federal University of São João del-Rei, The Ohio State University, University of Connecticut

Language: English

Topic: Statistical Methods and Inference

Subfield: Statistics and Probability

Field: Mathematics

Domain: Physical Sciences

Open Access status: green

Funders: Conselho Nacional de Desenvolvimento Científico e Tecnológico, College of Liberal Arts and Sciences, University of Connecticut

Award: G6317740448