Identification of POS Tags for the Khasi Language based on Brill’s Transformation Rule-Based Tagger



Título del documento: Identification of POS Tags for the Khasi Language based on Brill’s Transformation Rule-Based Tagger
Revue: Computación y sistemas
Base de datos:
Número de sistema: 000560685
ISSN: 1405-5546
Autores: 1
2
3
1
Instituciones: 1North Eastern Hill University, Department of Information Technology, Manipur. India
2National Institute of Technology, Department of Computer science and Engineering, Texas. Estados Unidos
3North Eastern Hill University, Department of Linguistics, Manipur. India
Año:
Periodo: Abr-Jun
Volumen: 26
Número: 2
Paginación: 989-1005
País: México
Idioma: Inglés
Resumen en inglés Khasi is a Mon-Khmer language that belongs to the Austro-Asiatic language family. Khasi language is spoken by the indigenous people of the state Meghalaya in the North-Eastern part of India. The main purpose of this paper is to develop Part-of-Speech (PoS) tagger for the Khasi language using a Rule-based approach. To work on POS tagging, one needs a grammatically tagged corpus. However, the Khasi language does not have a standard corpus for PoS tagging. Therefore, another aim or purpose of this paper is to develop a Khasi lexicon or POS corpus and using the Rule-Based Brill’s Transformation to automatically tag the given Khasi text. While anticipating the challenges in building such a corpus, this paper has brought out an analysis based on the Khasi corpus of around 1,03,998 words in its initial phase. We also show in this paper how the Khasi corpus is created. By using Brill’s Transformation rule-based learning on the created corpus in this preliminary study, accuracies of 97.73% and 95.52% were obtained on validating data and testing data respectively. This work is the first attempt to investigate POS tagging using the rule-based model with the designed Khasi POS corpus.
Keyword: Natural language processing (NLP),
Computational linguistic,
Part-of-speech (PoS),
PoS tagging,
Khasi language,
Khasi corpus,
Lexical morphology,
Transformation rule-based tagging
Texte intégral: Texto completo (Ver HTML) Texto completo (Ver PDF)