Work

Japanese SimCSE Technical Report

Year: 2023
Type: preprint
Abstract: We report the development of Japanese SimCSE, Japanese sentence embedding models fine-tuned with SimCSE. Since there is a lack of sentence embedding models for Japanese that can be used as a baseline in sentence embedding research, we conducted extensive experiments on Japanese sentence embeddings involving 24 pre-trained Japanese or multilingual language models, five supervised datasets, and four unsupervised datasets. In this report, we provide the detailed training setup for Japanese SimCSE and their evaluation results.
Institution: Nagoya University
Language: English
Open Access status: green
OpenAlex ID: W4388093422
Cites: 28
Cited by: 15
Related to: 10