Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
BERTScore
Description:
A text evaluation metric that compares candidate and reference texts using contextual token embeddings from pretrained language models.
Primary topic:
Topic Modeling (38%)
Related topics:
Topic Modeling (38%),
Natural Language Processing Techniques (13%),
Advanced Text Analysis Techniques (8%)
OpenAlex ID:
keywords/bertscore
BERTScore: Evaluating Text Generation with BERT
2019
·
Zhang, Tianyi
, Kishore, Varsha
, et al.
·
arXiv (Cornell University)
·
8,412
PDF
CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code
2023
·
Shuyan Zhou
, Uri Alon
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
254
PDF
Evaluating Question Answering Evaluation
2019
·
Anthony Chen
, Gabriel Stanovsky
, et al.
·
Workshop on Machine Reading for Question Answering (MRQA)
·
187
PDF
A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods
2021
·
Daniel Deutsch
, Rotem Dror
, et al.
·
Transactions of the Association for Computational Linguistics
·
122
PDF
SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics
2024
·
Takaaki Saeki
, Soumi Maiti
, et al.
·
Interspeech (USB)
·
118
PDF
Text Summarization Using Large Language Models: A Comparative Study of MPT-7b-instruct, Falcon-7b-instruct, and OpenAI Chat-GPT Models
2023
·
Basyal, Lochan
, Sanghvi, Mihir
·
arXiv (Cornell University)
·
114
PDF
Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scores
2024
·
Shaib, Chantal
, Govindarajan, Venkata S.
, et al.
·
arXiv (Cornell University)
·
98
PDF
Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric
2022
·
Giorgos Vernikos
, Brian Thompson
, et al.
·
Conference on Machine Translation (WMT)
·
92
PDF
BLEU, METEOR, BERTScore: Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment-oriented Text
2021
·
Hadeel Saadany
, Constantin Orăsan
·
Translation and Interpreting Technology Online Conference (TRITON)
·
91
PDF
Generating and Analyzing Chatbot Responses using Natural Language Processing
2019
·
Moneerh Aleedy
, Hadil Shaiba
, et al.
·
International Journal of Advanced Computer Science and Applications
·
91
PDF
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
2022
·
Tianxiang Sun
, Junliang He
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
88
PDF
Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT models
2023
·
Ranjit, Mercy
, Ganapathy, Gopinath
, et al.
·
arXiv (Cornell University)
·
84
PDF
A Study of Automatic Metrics for the Evaluation of Natural Language Explanations
2021
·
Miruna-Adriana Clinciu
, Arash Eshghi
, et al.
·
Conference of the European Chapter of the Association for Computational Linguistics
·
84
PDF
Retrieval-Augmented Generation Approach: Document Question Answering using Large Language Model
2024
·
Kurnia Muludi
, Kaira Milani Fitria
, et al.
·
International Journal of Advanced Computer Science and Applications
·
80
PDF
Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems
2020
·
Vitou Phy
, Yang Zhao
, et al.
·
International Conference on Computational Linguistics
·
77
PDF
The BEA 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues
2023
·
Anaïs Tack
, Ekaterina Kochmar
, et al.
·
Workshop on Innovative Use of NLP for Building Educational Applications
·
76
PDF
DEMETR: Diagnosing Evaluation Metrics for Translation
2022
·
Marzena Karpinska
, Nishant Raj
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
62
PDF
Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries
2021
·
Daniel Deutsch
, Dan Roth
·
Conference on Computational Natural Language Learning
·
62
PDF
Enhancing Trust in LLMs: Algorithms for Comparing and Interpreting LLMs
2024
·
Brown, Nik Bear
·
arXiv (Cornell University)
·
60
PDF
Analyzing the Performance of Large Language Models on Code Summarization
2024
·
Rajarshi Haldar
, Julia Hockenmaier
·
Language Resources and Evaluation Conference (LREC)
·
59
PDF
Improving Image Captioning Evaluation by Considering Inter References Variance
2020
·
Yanzhi Yi
, Hangyu Deng
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
57
A Comparative Study of Quality Evaluation Methods for Text Summarization
2024
·
Nguyen, Huyen
, Chen, Haihua
, et al.
·
arXiv (Cornell University)
·
53
PDF
Topic Modeling: Contextual Token Embeddings Are All You Need
2024
·
Dimo Angelov
, Diana Inkpen
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
53
PDF
Legal norm retrieval with variations of the bert model combined with TF-IDF vectorization
2021
·
Sabine Wehnert
, Viju Sudhi
, et al.
·
International Conference on Artificial Intelligence and Law
·
49
PDF
PEDANTS: Cheap but Effective and Interpretable Answer Equivalence
2024
·
Zongxia Li
, Ishani Mondal
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
47
PDF
Show more works
View as search
Works count:
925
Citation count:
14,080
Year
Topic
Type