Work

Encoding language diversity in TEI: a description of regional and non-standard languages in multilingual diachronic corpora

Year: 2025

Type: conference-paper

Abstract: French minority and regional languages remain under-resourced in digital formats, limiting cultural preservation and computational studies. The COLaF project develops corpora and NLP tools for French and languages spoken in France in synchrony and diachrony. This paper presents its TEI schema, which allows for the representation of linguistic variation across temporal, geographic and sociolinguistic dimensions. Using a combination of , and elements, the schema links text segments to metadata describing speakers, locations and varieties. Glottolog identifiers are used for non-standard languages. This paper advocates for the creation of a non-BCP 47-language attribute in TEI to enable the interoperability and TEI-compliance of corpora working on non-standard languages. The schema supports diverse document types from 17th-century monographs to web forums and has been applied to several corpora.

Source: HAL (Le Centre pour la Communication Scientifique Directe)

Authors: Janes, Juliette, Bawden, Rachel, Clérice, Thibault, Dent, Rasul, Ing, Lucence, Nédey, Oriane, Sagot, Benoît

Institution: ALMANACH: Modélisation et analyse linguistique automatique et humanités computationnelles

Language: English

Topic: Digital Humanities and Scholarship

Subfield: Literature and Literary Theory

Field: Arts and Humanities

Domain: Social Sciences

Open Access status: green

OpenAlex ID: W7081706538

FWCI:

Cites:

Cited by:

Related to: