Software Engineering for Large Language Models: Research Status, Challenges, and the Road Ahead
Year: 2026
Type: article
Abstract: The rapid advancement of large language models (LLMs) has redefined artificial intelligence (AI), pushing the boundaries of AI research and enabling unbounded possibilities for both academia and industry. However, LLM development faces increasingly complex challenges throughout its lifecycle, while existing research has not systematically investigated these challenges and solutions from the perspective of software engineering (SE) approaches. To fill the gap, we systematically analyze the research status throughout the LLM development lifecycle, which is divided into six phases: requirements engineering, dataset construction, model development and enhancement, testing and evaluation, deployment and operations, and maintenance and evolution. We conclude by identifying the key challenges in each phase and presenting potential research directions to address them. In general, we provide valuable insights from an SE perspective to facilitate future advances in LLM development.
DOI: 10.1145/3860527
Authors: Hongzhou Rao, Yanjie Zhao, Xinyi Hou, Shenao Wang, Haoyu Wang
Institution: Huazhong University of Science and Technology
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4416519717
