Work

Categorization according to Language: A step toward combining Linguistic Knowledge and Statistic Learning

Year: 1995
Type: conference-paper
Abstract: In this article, we address the problem of categorization according to language by presenting a method based on natural properties of language which allow us to categorize any kind of sentence with a very high success rate. The major difficulties in categorization are convergence and textual errors. Convergence since dealing with short entries involve discarding languages from few clues. Textual errors since documents coming from different electronic ways may contain spelling and grammatical errors as well as character recognition errors generated by OCR. We describe an approach to sentence categorization based on natural properties of languages. We combine several linguistic knowledge sources and we study their role. While our first system achieved a high success only on long sentences, we studied how overcoming the weaknesses and we present an interesting use of statistical profiles. Tested for french, english, spanish and german discrimination, the improvements are appreciable, achi...
Source: HAL
Authors: Emmanuel Giguet, Esplanade De La Paix
Institution: GREYC
Language: English
Open Access status: green
OpenAlex ID: W4297411348
FWCI: 0.38
Cites:
Cited by: 17
Related to: 10