Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
SciBERT
Description:
A pretrained language model based on the Transformer architecture, designed to represent and process scientific text for natural language processing tasks.
Primary topic:
Topic Modeling (32%)
Related topics:
Topic Modeling (32%),
Biomedical Text Mining and Ontologies (11%),
scientometrics and bibliometrics research (9%)
OpenAlex ID:
keywords/scibert
SciBERT: A Pretrained Language Model for Scientific Text
2019
·
Iz Beltagy
, Kyle Lo
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
4,473
PDF
MatSciBERT: A materials domain language model for text mining and information extraction
2022
·
Tanishq Gupta
, Mohd Zaki
, et al.
·
npj Computational Materials
·
533
PDF
SciBERT: A Pretrained Language Model for Scientific Text
2019
·
Beltagy, Iz
, Lo, Kyle
, et al.
·
arXiv (Cornell University)
·
378
PDF
ScienceQA: a novel resource for question answering on scholarly articles
2022
·
Tanik Saikh
, Tirthankar Ghosal
, et al.
·
International Journal on Digital Libraries
·
260
PDF
Quantifying the advantage of domain-specific pre-training on named entity recognition tasks in materials science
2022
·
Amalie Trewartha
, Nicholas Walker
, et al.
·
Patterns
·
229
PDF
SciBERT: Pretrained Contextualized Embeddings for Scientific Text
2019
·
Iz Beltagy
, Arman Cohan
, et al.
·
195
BatteryBERT: A Pretrained Language Model for Battery Database Enhancement
2022
·
Shu Huang
, Jacqueline M. Cole
·
Journal of Chemical Information and Modeling
·
187
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition
2020
·
Yun He
, Ziwei Zhu
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
152
PDF
Context Matters: A Strategy to Pre-train Language Model for Science Education
2023
·
Zhengliang Liu
, Xinyu He
, et al.
·
Communications in computer and information science
·
93
PDF
Keyphrase Extraction as Sequence Labeling Using Contextualized Embeddings
2020
·
Dhruva Sahrawat
, Debanjan Mahata
, et al.
·
Lecture notes in computer science
·
86
PDF
Using the contextual language model BERT for multi-criteria classification of scientific articles
2020
·
Ashwin Karthik Ambalavanan
, Murthy V. Devarakonda
·
Journal of Biomedical Informatics
·
76
PDF
BERT, ELMo, use and infersent sentence encoders: The Panacea for research-paper recommendation?
2019
·
Hebatallah A. Mohamed Hassan
, Giuseppe Sansonetti
, et al.
·
Iris (Roma Tre University)
·
76
A comparative study of pre-trained language models for named entity recognition in clinical trial eligibility criteria from multiple corpora
2022
·
Jianfu Li
, Qiang Wei
, et al.
·
BMC Medical Informatics and Decision Making
·
63
PDF
Towards Effective Identification of Attack Techniques in Cyber Threat Intelligence Reports using Large Language Models
2025
·
Hoang Cuong Nguyen
, Shahroz Tariq
, et al.
·
International World Wide Web Conference (WWW)
·
62
PDF
Local Citation Recommendation with Hierarchical-Attention Text Encoder and SciBERT-Based Reranking
2022
·
Nianlong Gu
, Yingqiang Gao
, et al.
·
Lecture notes in computer science
·
58
PDF
Rise of Generative Artificial Intelligence in Science
2025
·
Liangping Ding
, Cornelia Lawson
, et al.
·
Scientometrics
·
53
PDF
COVIDSum: A linguistically enriched SciBERT-based summarization model for COVID-19 scientific papers
2022
·
Xiaoyan Cai
, Sen Liu
, et al.
·
Journal of Biomedical Informatics
·
52
Unsupervised Pre-training for Biomedical Question Answering
2020
·
Kommaraju, Vaishnavi
, Gunasekaran, Karthick
, et al.
·
arXiv (Cornell University)
·
51
PDF
Revisiting Electrocatalyst Design by a Knowledge Graph of Cu-Based Catalysts for CO 2 Reduction
2023
·
Yang Gao
, Ludi Wang
, et al.
·
ACS Catalysis
·
50
Aspect-based Document Similarity for Research Papers
2020
·
Malte Ostendorff
, Terry Ruas
, et al.
·
International Conference on Computational Linguistics
·
48
PDF
The Impact of Domain-Specific Pre-Training on Named Entity Recognition Tasks in Materials Science
2021
·
Nicholas Walker
, Amalie Trewartha
, et al.
·
SSRN Electronic Journal
·
47
Biomedical Event Extraction as Multi-turn Question Answering
2020
·
Xing David Wang
, Leon Weber
, et al.
·
International Workshop on Health Text Mining and Information Analysis (LOUHI)
·
47
PDF
SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction Tasks
2022
·
Yuna Jeong
, Eunhui Kim
·
IEEE Access
·
45
Advances in Pre-trained Language Models for Domain-Specific Text Classification: A Systematic Review
2025
·
Zhyar Rzgar K. Rostam
, Gábor Kertész
·
ACM Transactions on Intelligent Systems and Technology
·
41
PDF
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding
2021
·
Dustin Wright
, Isabelle Augenstein
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
41
PDF
Show more works
View as search
Works count:
576
Citation count:
9,752
Year
Topic
Type