Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
BabyLM
Description:
A shared-task and workshop initiative studying sample-efficient pretraining of language models using child-scale language data.
Primary topic:
Topic Modeling (41%)
Related topics:
Topic Modeling (41%),
Natural Language Processing Techniques (23%),
Language Development and Disorders (11%)
Wikidata ID:
wiki/Q141203819
OpenAlex ID:
keywords/babylm
MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
2023
·
Huang, Qian
, Vora, Jian
, et al.
·
arXiv (Cornell University)
·
384
PDF
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora
2023
·
Alex Warstadt
, Aaron Mueller
, et al.
·
BabyLM Challenge
·
372
PDF
Tiny Language Models for Automation and Control: Overview, Potential Applications, and Future Research Directions
2025
·
Ismail Lamaakal
, Yassine Maleh
, et al.
·
Sensors
·
92
PDF
Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty
2023
·
Inar Timiryasov
, Jean-Loup Tastet
·
BabyLM Challenge
·
92
PDF
Large GPT-like Models are Bad Babies: A Closer Look at the Relationship between Linguistic Competence and Psycholinguistic Measures
2023
·
Julius Steuer
, Marius Mosbach
, et al.
·
BabyLM Challenge
·
26
PDF
From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes
2024
·
Goriely, Z
, Martinez, RD
, et al.
·
arXiv (Cornell University)
·
17
PDF
Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settings
2023
·
David Samuel
·
BabyLM Challenge
·
17
PDF
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pre-training of BabyLM
2024
·
Zhewen Shen
, Aditya Joshi
, et al.
·
Workshop on Cognitive Modeling and Computational Linguistics (CMCL)
·
10
PDF
McGill BabyLM Shared Task Submission: The Effects of Data Formatting and Structural Biases
2023
·
Ziling Cheng
, Rahul Aralikatte
, et al.
·
BabyLM Challenge
·
10
PDF
Dialogue Is Not Enough to Make a Communicative BabyLM (But Neither Is Developmentally Inspired Reinforcement Learning)
2025
·
Francesca Padovani
, Bastian Bunzeck
, et al.
·
BabyLM Workshop
·
9
PDF
Graphemes vs. phonemes: battling it out in character-based language models
2024
·
Bunzeck, Bastian ; https://orcid.org/0000-0002-1832-4068
, Duran, Daniel ; https://orcid.org/0000-0001-6769-2281
, et al.
·
Publikationen an der Universität Bielefeld (Universität Bielefeld)
·
9
Can training neural language models on a curriculum with developmentally plausible data improve alignment with human reading behavior?
2023
·
Aryaman Chobey
, Oliver Smith
, et al.
·
BabyLM Challenge
·
9
PDF
Are BabyLMs Deaf to Gricean Maxims? A Pragmatic Evaluation of Sample-efficient Language Models
2025
·
Raha Askari
, Sina Zarrieß
, et al.
·
BabyLM Workshop
·
8
PDF
GPT-wee: How Small Can a Small Language Model Really Get?
2023
·
Bastian Bunzeck
, Sina Zarrieß
·
BabyLM Challenge
·
8
PDF
BabyStories: Can Reinforcement Learning Teach Baby Language Models to Write Better Stories?
2023
·
Xingmeng Zhao
, Tongnian Wang
, et al.
·
BabyLM Challenge
·
7
PDF
Tiny Language Models Enriched with Multimodal Knowledge from Multiplex Networks
2023
·
Clayton Fields
, Osama Natouf
, et al.
·
BabyLM Challenge
·
7
PDF
BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop
2025
·
Charpentier, Lucas
, Choshen, Leshem
, et al.
·
arXiv (Cornell University)
·
6
PDF
Teacher Demonstrations in a BabyLM’s Zone of Proximal Development for Contingent Multi-Turn Interaction
2025
·
Suchir Salhan
, Hongyi Gu
, et al.
·
BabyLM Workshop
·
6
PDF
Linguistic Units as Tokens: Intrinsic and Extrinsic Evaluation with BabyLM
2025
·
Achille Fusco
, Maria Letizia Piccini Bianchessi
, et al.
·
BabyLM Workshop
·
6
PDF
On the effect of curriculum learning with developmental data for grammar acquisition
2023
·
Mattia Opper
, J. Morrison
, et al.
·
BabyLM Challenge
·
6
PDF
What is the Best Sequence Length for BabyLM?
2025
·
Suchir Salhan
, Richard Diehl Martinez
, et al.
·
BabyLM Workshop
·
5
PDF
LongTail-Swap: benchmarking language models' abilities on rare words
2025
·
Algayres, Robin
, Saint-James, Charles-Éric
, et al.
·
arXiv (Cornell University)
·
4
PDF
Do Syntactic Categories Help in Developmentally Motivated Curriculum Learning for Language Models?
2025
·
Arzu Burcu Güven
, Anna Rogers
, et al.
·
BabyLM Workshop
·
4
PDF
Pretraining Language Models with LoRA and Artificial Languages
2025
·
Nalin Kumar
, Mateusz Lango
, et al.
·
BabyLM Workshop
·
4
PDF
ChapGTP, ILLC’s Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation
2023
·
Jaap Jumelet
, Michael Hanna
, et al.
·
BabyLM Challenge
·
4
PDF
Show more works
View as search
Works count:
123
Citation count:
1,179
Year
Topic
Type