Work

A Systematic Evaluation of Large Code Models in API Suggestion: When, Which, and How

Year: 2024
Type: conference-paper
Abstract: API suggestion is a critical task in modern software development, assisting programmers by predicting and recommending third-party APIs based on the current context. Recent advancements in large code models (LCMs) have shown promise in the API suggestion task. However, they mainly focus on suggesting which APIs to use, ignoring that programmers may demand more assistance while using APIs in practice including when to use the suggested APIs and how to use the APIs. To mitigate the gap, we conduct a systematic evaluation of LCMs for the API suggestion task in the paper.
Language: English
Open Access status: green
OpenAlex ID: W4403536740
FWCI: 2.69
Cites: 20
Cited by: 7
Related to: 10