Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
audio captioning
Description:
The task of generating natural-language descriptions of sounds or audio recordings, often using machine-learning methods.
Primary topic:
Music and Audio Processing (46%)
Related topics:
Music and Audio Processing (46%),
Speech Recognition and Synthesis (16%),
Multimodal Machine Learning Applications (16%),
Subtitles and Audiovisual Media (8%)
OpenAlex ID:
keywords/audio-captioning
AudioCaps: Generating Captions for Audios in The Wild
2019
·
Chris Dongjoo Kim
, Byeongchang Kim
, et al.
·
Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
·
1,047
Clotho: an Audio Captioning Dataset
2020
·
Konstantinos Drossos
, Samuel Lipping
, et al.
·
IEEE International Conference on Acoustics Speech and Signal Processing
·
763
PDF
SALMONN: Towards Generic Hearing Abilities for Large Language Models
2023
·
Tang, Changli
, Yu, Wenyi
, et al.
·
International Conference on Learning Representations
·
584
WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research
2024
·
Xinhao Mei
, Chutong Meng
, et al.
·
IEEE/ACM Transactions on Audio Speech and Language Processing
·
521
PDF
Diffsound: Discrete Diffusion Model for Text-to-Sound Generation
2023
·
Dongchao Yang
, Jianwei Yu
, et al.
·
IEEE/ACM Transactions on Audio Speech and Language Processing
·
483
PDF
Unsupervised learning of spoken language with visual context
2016
·
David Harwath
, Antonio Torralba
, et al.
·
DSpace@MIT (Massachusetts Institute of Technology)
·
271
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
2023
·
Sihan Chen
, Handong Li
, et al.
·
neural information processing systems
·
268
PDF
Audiobox: Unified Audio Generation with Natural Language Prompts
2023
·
Vyas, Apoorv
, Shi, Bowen
, et al.
·
arXiv (Cornell University)
·
257
PDF
Listen, Think, and Understand
2023
·
Gong, Yuan
, Luo, Hongyin
, et al.
·
International Conference on Learning Representations
·
219
MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
2025
·
Ziyang Ma
, Yinghao Ma
, et al.
·
neural information processing systems
·
215
PDF
Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
2025
·
Ghosh, Sreyan
, Kong, Zhifeng
, et al.
·
arXiv (Cornell University)
·
210
PDF
Audio Retrieval With Natural Language Queries: A Benchmark Study
2022
·
A. Sophia Koepke
, Andreea-Maria Oncescu
, et al.
·
IEEE Transactions on Multimedia
·
159
PDF
Automated audio captioning with recurrent neural networks
2017
·
Konstantinos Drossos
, Sharath Adavanne
, et al.
·
IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
·
156
PDF
Separate What You Describe: Language-Queried Audio Source Separation
2022
·
Xubo Liu
, Haohe Liu
, et al.
·
Interspeech (USB)
·
126
PDF
The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluation
2023
·
Manco, Ilaria
, Weck, Benno
, et al.
·
arXiv (Cornell University)
·
116
PDF
Learning Word-Like Units from Joint Audio-Visual Analysis
2017
·
David Harwath
, James Glass
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
114
PDF
Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
2025
·
Ziyang Ma
, Zhuo Chen
, et al.
·
IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
·
107
PDF
Pengi: An Audio Language Model for Audio Tasks
2023
·
Deshmukh, Soham
, Elizalde, Benjamin
, et al.
·
arXiv (Cornell University)
·
99
PDF
Image and audio caps: automated captioning of background sounds and images using deep learning
2022
·
M. Poongodi
, Mounir Hamdi
, et al.
·
Multimedia Systems
·
99
PDF
Can Audio Captions Be Evaluated With Image Caption Metrics?
2022
·
Zelin Zhou
, Zhiling Zhang
, et al.
·
IEEE International Conference on Acoustics Speech and Signal Processing
·
89
Audio Captioning Transformer
2021
·
Mei, Xinhao
, Liu, Xubo
, et al.
·
arXiv (Cornell University)
·
83
PDF
On Metric Learning for Audio-Text Cross-Modal Retrieval
2022
·
Xinhao Mei
, Xubo Liu
, et al.
·
Interspeech (USB)
·
80
PDF
Auto-ACD: A Large-scale Dataset for Audio-Language Representation Learning
2024
·
Luoyi Sun
, Xuenan Xu
, et al.
·
ACM International Conference on Multimedia (ACM MM)
·
77
PDF
Audio Caption: Listen and Tell
2019
·
Mengyue Wu
, Heinrich Dinkel
, et al.
·
IEEE International Conference on Acoustics Speech and Signal Processing
·
77
PDF
Large-Scale Representation Learning from Visually Grounded Untranscribed Speech
2019
·
Gabriel Ilharco
, Yuan Zhang
, et al.
·
Conference on Computational Natural Language Learning
·
77
PDF
Show more works
View as search
Works count:
506
Citation count:
9,705
Year
Topic
Type