Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
evaluation pitfalls
Description:
Common errors, limitations, or sources of bias that can undermine the validity or usefulness of an evaluation.
Related topic:
Evaluation and Performance Assessment (20%)
OpenAlex ID:
keywords/evaluation-pitfalls
Forecast evaluation for data scientists: common pitfalls and best practices
2022
·
Hansika Hewamalage
, Klaus Ackermann
, et al.
·
Data Mining and Knowledge Discovery
·
510
PDF
All-paths graph kernel for protein-protein interaction extraction with evaluation of cross-corpus learning
2008
·
Antti Airola
, Sampo Pyysalo
, et al.
·
BMC Bioinformatics
·
310
PDF
The (black) art of runtime evaluation: Are we comparing algorithms or implementations?
2016
·
Hans-Peter Kriegel
, Erich Schubert
, et al.
·
Knowledge and Information Systems
·
283
Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarking
2023
·
Juanhui Li
, Harry Shomer
, et al.
·
neural information processing systems
·
168
PDF
Some Pitfalls in the Evaluation of Screening Programs
1969
·
Manning Feinleib
, Marvin Zelen
·
Archives of Environmental Health An International Journal
·
121
Handbook of Evaluation Methods for Health Informatics
2006
·
Elsevier eBooks
·
115
A graph kernel for protein-protein interaction extraction
2008
·
Antti Airola
, Sampo Pyysalo
, et al.
·
Workshop on Biomedical Language Processing (BioNLP)
·
101
PDF
Pitfalls in Parallel Job Scheduling Evaluation
2005
·
Eitan Frachtenberg
, Dror G. Feitelson
·
Lecture notes in computer science
·
96
A Field Guide to Automatic Evaluation of LLM-Generated Summaries
2024
·
Tempest A. van Schaik
, Brittany Pugh
·
International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
·
84
A case study of the Hirsch index for 26 non-prominent physicists
2007
·
M. Schreiber
·
Annalen der Physik
·
82
PDF
Undertaking sociotechnical evaluations of health information technologies
2014
·
Kathrin M Cresswell
, Aziz Sheikh
·
Journal of Innovation in Health Informatics
·
70
Reduction of bias and variance for evaluation of computer‐aided diagnostic schemes
2006
·
Qiang Li
, Kunio Doi
·
Medical Physics
·
66
PDF
Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions
2021
·
O'Bray, Leslie
, Horn, Max
, et al.
·
arXiv (Cornell University)
·
59
PDF
On Evaluating the Durability of Safeguards for Open-Weight LLMs
2024
·
Qi, Xiangyu
, Wei, Boyi
, et al.
·
arXiv (Cornell University)
·
54
PDF
Problems and Pitfalls in the Evaluation of Adaptive Systems
2005
·
Stephan Weibelzahl
·
IGI Global eBooks
·
52
Pitfalls in the Evaluation of Teachers by Principals.
1980
·
Gary Natriello
, Sanford M. Dornbusch
·
Administrator's Notebook
·
46
A case study of the Hirsch index for 26 non‐prominent physicists
2007
·
M. Schreiber
·
Annalen der Physik
·
44
Pitfalls and Best Practices in Evaluation of AI Algorithmic Biases in Radiology
2025
·
Paul H. Yi
, Preetham Bachina
, et al.
·
Radiology
·
41
Reality Bites: Making Realist Evaluation Useful in the Real World
2020
·
Melanie Punton
, Vogel Isabel
, et al.
·
Figshare
·
41
Functional restoration. Pitfalls in evaluating efficacy.
1992
·
R J Gatchel
, T G Mayer
, et al.
·
PubMed
·
39
Evaluation Strategies for Human Service Programs: A Guide for Policy Makers and Providers
1996
·
Adele V. Harrell
·
37
The devil is in the details: Implementing secular outcome measurement methods in faith‐based organizations
2004
·
Robert L. Fischer
·
Nonprofit Management and Leadership
·
33
Pitfalls in the Evaluation of Sentence Embeddings
2019
·
Steffen Eger
, Andreas Rücklé
, et al.
·
Workshop on Representation Learning for NLP (RepL4NLP)
·
28
PDF
Toward a standardized evaluation of imputation methodology
2023
·
Hanne I. Oberman
, Gerko Vink
·
Biometrical Journal
·
27
PDF
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
2023
·
Hao Peng
, Xiaozhi Wang
, et al.
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
27
PDF
Show more works
View as search
Works count:
172
Citation count:
2,416
Year
Topic
Type