Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
Longformer
Description:
Longformer is a transformer-based neural network architecture designed to process long sequences of text efficiently in natural language processing.
Primary topic:
Topic Modeling (32%)
Related topics:
Topic Modeling (32%),
Machine Learning in Healthcare (8%),
Artificial Intelligence in Law (8%)
OpenAlex ID:
keywords/longformer
Longformer: The Long-Document Transformer
2020
·
Beltagy, Iz
, Peters, Matthew E.
, et al.
·
arXiv (Cornell University)
·
7,644
PDF
Efficient Transformers: A Survey
2022
·
Yi Tay
, Mostafa Dehghani
, et al.
·
ACM Computing Surveys
·
2,273
Long Range Arena: A Benchmark for Efficient Transformers
2020
·
Tay, Yi
, Dehghani, Mostafa
, et al.
·
arXiv (Cornell University)
·
724
PDF
Text Is All You Need: Learning Language Representations for Sequential Recommendation
2023
·
Jiacheng Li
, Ming Wang
, et al.
·
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
·
471
PDF
Lawformer: A pre-trained language model for Chinese legal long documents
2021
·
Chaojun Xiao
, Xueyu Hu
, et al.
·
AI Open
·
453
A Practical Survey on Faster and Lighter Transformers
2023
·
Quentin Fournier
, Gaétan Marceau Caron
, et al.
·
ACM Computing Surveys
·
220
PDF
Unlimiformer: Long-Range Transformers with Unlimited Length Input
2023
·
Amanda Bertsch
, Uri Alon
, et al.
·
neural information processing systems
·
194
PDF
A comparative study of pretrained language models for long clinical text
2022
·
Yikuan Li
, Ramsey M Wehbe
, et al.
·
Journal of the American Medical Informatics Association
·
191
MultiLegalPile: A 689GB Multilingual Legal Corpus
2024
·
Joel Niklaus
, Veton Matoshi
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
134
PDF
Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding
2022
·
Zhichao Yang
, Shufan Wang
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
90
PDF
Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer
2022
·
Dimitris Mamakas
, Petros Tsotsi
, et al.
·
Natural Legal Language Processing Workshop (NLLP)
·
87
PDF
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification
2022
·
Chalkidis, Ilias
, Dai, Xiang
, et al.
·
arXiv (Cornell University)
·
84
PDF
Identifying Machine-Paraphrased Plagiarism
2022
·
Jan Philip Wahle
, Terry Ruas
, et al.
·
Lecture notes in computer science
·
83
PDF
LongFormer: Longitudinal Transformer for Alzheimer’s Disease Classification with Structural MRIs
2024
·
Qiuhui Chen
, Qiang Fu
, et al.
·
IEEE Winter Conference on Applications of Computer Vision
·
72
PDF
A Comparative Study on Embedding Models for Keyword Extraction Using KeyBERT Method
2023
·
Bayan Issa
, Muhammed Basheer Jasser
, et al.
·
IEEE International Conference on System Engineering and Technology (ICSET)
·
69
Combining Lexical and Neural Retrieval with Longformer-based Summarization for Effective Case Law Retrieval.
2021
·
Arian Askari
, Suzan Verberne
·
64
Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health
2023
·
Ji, Shaoxiong
, Zhang, Tianlin
, et al.
·
arXiv (Cornell University)
·
54
PDF
SALO: an efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences
2022
·
Guan Shen
, Jieru Zhao
, et al.
·
ACM/IEEE Design Automation Conference (DAC)
·
54
PDF
ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the US
2022
·
Gil Semo
, Dor Bernsohn
, et al.
·
Natural Legal Language Processing Workshop (NLLP)
·
49
PDF
Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection
2021
·
Jan Philip Wahle
, Terry Ruas
, et al.
·
ACM/IEEE Joint Conference on Digital Libraries
·
49
PDF
Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Calls
2024
·
Pedro Miguel Sánchez Sánchez
, Alberto Huertas Celdrán
, et al.
·
IEEE Military Communications Conference (MILCOM)
·
48
PDF
The NLP Task Effectiveness of Long-Range Transformers
2023
·
Guanghui Qin
, Yukun Feng
, et al.
·
Conference of the European Chapter of the Association for Computational Linguistics
·
47
PDF
ConceptEVA: Concept-Based Interactive Exploration and Customization of Document Summaries
2023
·
Xiaoyu Zhang
, Jianping Li
, et al.
·
CHI Conference on Human Factors in Computing Systems
·
46
PDF
Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis
2022
·
Sandra Wankmüller
·
Sociological Methods & Research
·
46
PDF
Transformers for Multi-label Classification of Medical Text: An Empirical Comparison
2021
·
Vithya Yogarajan
, Jacob Montiel
, et al.
·
Lecture notes in computer science
·
41
PDF
Show more works
View as search
Works count:
462
Citation count:
15,430
Year
Topic
Type