Work

Hybrid Denoising-screening for High-dimensional Contaminated Data

Year: 2025

Type: article

Abstract: Feature screening is an effective tool to eliminate irrelevant features in high-dimensional analysis.When a high-dimensional dataset is contaminated with noisy observations, the conventional screening methods may lead to a poor screening accuracy.To tackle this problem, one practical strategy is to remove noisy observations and irrelevant features simultaneously.In this paper, we propose a novel hybrid denoising-screening (HDS) procedure for high-dimensional contaminated data.The new method is built upon a dual sample-feature L0 fitting procedure, which precisely controls both numbers of observations and features to be retained for the analysis.In the HDS process, only clean observations are selected and the joint effects between features are naturally accounted.These merits give HDS an edge to outperform the existing screening methods when faced with contaminated data.The promising performance of the method is supported by both theories and numerical examples.

Source: Statistica Sinica

DOI: 10.5705/ss.202024.0248

Authors: Liming Wang, Peng Lai, Chen Xu, Xingxiang Li

Institutions: Nanjing University of Information Science and Technology, Peng Cheng Laboratory, Xi'an Jiaotong University

Language: English

Topic: Statistical Methods and Inference

Subfield: Statistics and Probability

Field: Mathematics

Domain: Physical Sciences

Open Access status: bronze

Funders: Peng Cheng Laboratory, National Natural Science Foundation of China, China Postdoctoral Science Foundation, Government of Jiangsu Province, Qinglan Project of Jiangsu Province of China, Fundamental Research Funds for the Central Universities

OpenAlex ID: W7077071753

FWCI:

Cites:

Cited by:

Related to: