Year: 2012
Type: conference-paper
Abstract: This paper presents the first phase of building YADAC -a multi-genre Dialectal Arabic (DA) corpus -that is compiled using Web data from microblogs (i.e.Twitter), blogs/forums and online knowledge market services in which both questions and answers are user-generated.In addition to introducing two new genres to the current efforts of building DA corpora (i.e.microblogs and question-answer pairs extracted from online knowledge market services), the paper highlights and tackles several new issues related to building DA corpora that have not been handled in previous studies: function-based Web harvesting and dialect identification, vowel-based spelling variation, linguistic hypercorrection and its effect on spelling variation, unsupervised Part-of-Speech (POS) tagging and base phrase chunking for DA.Although the algorithms for both POS tagging and base-phrase chunking are still under development, the results are promising.
Authors: Rania Al-Sabbagh, Roxana Girju
Institution: University of Illinois Urbana-Champaign
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W2251657882