Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
label quality
Description:
The accuracy, consistency, and suitability of annotations used as labels in machine learning and related modeling tasks.
Primary topic:
Mobile Crowdsensing and Crowdsourcing (20%)
Related topics:
Mobile Crowdsensing and Crowdsourcing (20%),
Machine Learning and Data Classification (12%)
OpenAlex ID:
keywords/label-quality
Get another label? improving data quality and data mining using multiple, noisy labelers
2008
·
Victor S. Sheng
, Foster Provost
, et al.
·
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
·
1,367
PDF
Confident Learning: Estimating Uncertainty in Dataset Labels
2021
·
Curtis Northcutt
, Lu Jiang
, et al.
·
Journal of Artificial Intelligence Research
·
1,335
PDF
Hidden stratification causes clinically meaningful failures in machine learning for medical imaging
2020
·
Luke Oakden-Rayner
, Jared Dunnmon
, et al.
·
ACM Conference on Health, Inference, and Learning (CHIL)
·
704
Large Language Models can Accurately Predict Searcher Preferences
2024
·
Paul Thomas
, Seth Spielman
, et al.
·
International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
·
397
Revolt: Collaborative Crowdsourcing for Labeling Machine Learning Datasets
2017
·
Joseph Chee Chang
, Saleema Amershi
, et al.
·
CHI Conference on Human Factors in Computing Systems
·
302
Learning from crowdsourced labeled data: a survey
2016
·
Jing Zhang
, Xindong Wu
, et al.
·
Artificial Intelligence Review
·
238
In Search of Quality in Crowdsourcing for Search Engine Evaluation
2011
·
Gabriella Kazai
·
Lecture notes in computer science
·
220
Repeated labeling using multiple noisy labelers
2013
·
Panagiotis G. Ipeirotis
, Foster Provost
, et al.
·
Data Mining and Knowledge Discovery
·
201
Vox Populi: Collecting High-Quality Labels from a Crowd
2009
·
Ofer Dekel
, Ohad Shamir
·
Conference on Learning Theory
·
162
Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations
2022
·
Kang Min Yoo
, Junyeob Kim
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
156
PDF
Machine Learning with Crowdsourcing: A Brief Summary of the Past Research and Future Directions
2019
·
Victor S. Sheng
, Jing Zhang
·
Proceedings of the AAAI Conference on Artificial Intelligence
·
153
The face of quality in crowdsourcing relevance labels: demographics, personality and labeling accuracy
2012
·
Gabriella Kazai
, Jaap Kamps
, et al.
·
ACM International Conference on Information and Knowledge Management (CIKM)
·
139
Optimistic Knowledge Gradient Policy for Optimal Budget Allocation in Crowdsourcing
2013
·
Xi Chen
, Qihang Lin
, et al.
·
International Conference on Machine Learning
·
134
Improving Crowdsourced Label Quality Using Noise Correction
2017
·
Jing Zhang
, Victor S. Sheng
, et al.
·
IEEE Transactions on Neural Networks and Learning Systems
·
132
Designing Ground Truth and the Social Life of Labels
2021
·
Michael Muller
, Christine T. Wolf
, et al.
·
CHI Conference on Human Factors in Computing Systems
·
125
A General Cartographic Labelling Algorithm
1996
·
Shawn Edmondson
, Jon Christensen
, et al.
·
Cartographica The International Journal for Geographic Information and Geovisualization
·
112
Enterprise Modelling and Information Systems Architectures
2012
·
Henrik Leopold
, Sergey Smirnov
, et al.
·
Enterprise modelling and information systems architectures
·
111
Weakly Labelled AudioSet Tagging With Attention Neural Networks
2019
·
Qiuqiang Kong
, Changsong Yu
, et al.
·
IEEE/ACM Transactions on Audio Speech and Language Processing
·
100
PDF
On the Importance of Label Quality for Semantic Segmentation
2018
·
Aleksandar Zlateski
, Ronnachai Jaroensri
, et al.
·
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
·
92
Label augmented and weighted majority voting for crowdsourcing
2022
·
Ziqi Chen
, Liangxiao Jiang
, et al.
·
Information Sciences
·
84
Anti-Interference From Noisy Labels: Mean-Teacher-Assisted Confident Learning for Medical Image Segmentation
2022
·
Zhe Xu
, Donghuan Lu
, et al.
·
IEEE Transactions on Medical Imaging
·
79
Who Should Label What? Instance Allocation in Multiple Expert Active Learning
2011
·
Byron C. Wallace
, Kevin Small
, et al.
·
SIAM International Conference on Data Mining
·
75
Label noise correction and application in crowdsourcing
2016
·
Bryce Nicholson
, Victor S. Sheng
, et al.
·
Expert Systems with Applications
·
69
PDF
Crowd Worker Strategies in Relevance Judgment Tasks
2020
·
Lei Han
, Eddy Maddalena
, et al.
·
ACM International Conference on Web Search and Data Mining (WSDM)
·
64
A Diverse Large-Scale Building Dataset and a Novel Plug-and-Play Domain Generalization Method for Building Extraction
2023
·
Muying Luo
, Shunping Ji
, et al.
·
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
·
63
PDF
Show more works
View as search
Works count:
405
Citation count:
9,052
Year
Topic
Type