Work

The Unreasonable Effectiveness of LLMs for Query Optimization

Year: 2024
Type: preprint
Abstract: Recent work in database query optimization has used complex machine learning strategies, such as customized reinforcement learning schemes. Surprisingly, we show that LLM embeddings of query text contain useful semantic information for query optimization. Specifically, we show that a simple binary classifier deciding between alternative query plans, trained only on a small number of labeled embedded query vectors, can outperform existing heuristic systems. Although we only present some preliminary results, an LLM-powered query optimizer could provide significant benefits, both in terms of performance and simplicity.
Language: English
Open Access status: green
OpenAlex ID: W4404404113
Cites:
Cited by: 2
Related to: 10