Work

Human-centric Evaluation of Semantic Resources:A Systematic Mapping Study Protocol and Data

Year: 2024

Type: article

Abstract: We perform a Systematic Mapping Study on the topic of Human-centric Evaluation of Semantic Resources. In this resource, we include: the study protocol we followed to conduct the study HESR_SMS_Protocol.pdf the collected data from 100 primary studies (as a google sheet/csv/knowledge graph) HESR_SMS_ExtractedData Google Sheet HESR_SMS_ExtractedData.csv HESR_SMS_ExtractedData_ColumValues.csv HESR_KG.owl the implemented data analysis notebooks Bibliographic Analysis (Google Colaboratory Notebooks) D2_D3_PapersPerYear_PaperTypes.ipynb D5_AuthorAffiliations.ipynb D6_Keywords.ipynb D23_D28_PaperQualty.ipynb RQ1. Semantic Resource Analysis (Google Colaboratory Notebooks) D7a_D7b_ResourceTypes_AuthorVsReviewer.ipynb D7b_ResourceTypesReviewer.ipynb D7c_EvaluatedResources(PerDomain).ipynb D8_SizeOfResource.ipynb D9_FormalismOfResource.ipynb RQ2. Evlaution Process Analysis (Google Colaboratory Notebooks) D10_VerifiedAspect.ipynb D11_FrameOfReference.ipynb D12_ContextOfEvaluation.ipynb D13_EvaluationMethod.ipynb D14_EvaluationModality.ipynb D15_BiasAddressed.ipynb RQ3. Evaluation Population Analysis (Google Colaboratory Notebooks) D16_EvaluatorTask.ipynb D17_D22_PopulationCharacteristics.ipynb

Source: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.10796917

Authors: Sabou, Marta, Tsaneva, Stefani, Fernandez, Miriam, Poveda-Villalon, María, Suárez-Figueroa, Mari Carmen

Institutions: Vienna University of Economics and Business, The Open University, Universidad Politécnica de Madrid

Language: English

Topic: Semantic Web and Ontologies

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: Austrian Science Fund

Award: Human-centric Ontology Evaluation (HOnEst)