speculative decoding
Description: An inference technique for language models that uses a draft model to propose tokens for verification by a larger target model.
Primary topic: Natural Language Processing Techniques (43%)
Wikidata ID: wiki/Q139963345
OpenAlex ID: keywords/speculative-decoding
