Year: 2026
Type: conference-paper
Abstract: Automated feature engineering (AutoFE) liberates data scientists from the burden of manual feature construction.The semantic information of datasets contains rich context information for feature engineering but has been underutilized in many existing AutoFE works.We present PromptFE, a novel AutoFE framework that leverages large language models (LLMs) to automatically construct features in a compact string format and generate semantic explanations based on dataset descriptions.By learning the performance of constructed features in context, the LLM iteratively improves feature construction.We demonstrate through experiments on real-world datasets the superior performance of PromptFE over state-ofthe-art AutoFE methods.We verify the impact of dataset semantic information and provide comprehensive study on the LLM-based feature construction process.
Authors: Yufeng Zou, Jean Utke, Diego Klabjan, Han Liu
Institution: Northwestern University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7140127683