Work

Language Model Adaptation for Legal Ukrainian Domain

Year: 2024
Type: article
Abstract: Language models in recent decades make a huge step towards solving the tasks that previously could be done only by humans. Development of NLP area is different scopes gives an opportunity to solve domain specific tasks and transfer knowledge from learnt data towards the useful inferences based on that. This article provides the NLP model approach in specific legal domain. Additionally, this article explores performance of pre-training small models and its utilization and checks the scores on fine-tuned task of checking sentence similarities via SBERT. According to this articles it is proven that domain-specific pre-trained models can perform better results than generally trained language model. This article also provides the language model that is adopted to the Ukrainian legal domain.
Language: English
Open Access status: diamond
OpenAlex ID: W4404020740
FWCI:
Cites:
Cited by:
Related to: 10