Named Entity Recognition on Code-Mixed Cross-Script Social Media Content



Document title: Named Entity Recognition on Code-Mixed Cross-Script Social Media Content
Journal: Computación y sistemas
Database: PERIÓDICA
System number: 000423313
ISSN: 1405-5546
Authors: 1
1
2
1
Institutions: 1Jadavpur University, Calcuta, Bengala Occidental. India
2Universidad Politécnica de Valencia, Valencia. España
Year:
Season: Oct-Dic
Volumen: 21
Number: 4
Country: México
Language: Inglés
Document type: Artículo
Approach: Aplicado, descriptivo
English abstract Focusing on the current multilingual scenario in social media, this paper reports automatic extraction of named entities (NE) from code-mixed cross-script social media data. Our prime target is to extract NE for question answering. This paper also introduces a Bengali-English (Bn-En) code-mixed cross-script dataset for NE research and proposes domain specific taxonomies for NE. We used formal as well as informal language-specific features to prepare the classification models and employed four machine learning algorithms (Conditional Random Fields, Margin Infused Relaxed Algorithm, Support Vector Machine and Maximum Entropy Markov Model) for the NE recognition (NER) task. In this study, Bengali is considered as the native language while English is considered as the non-native language. However, the approach presented in this paper is generic in nature and could be used for any other code-mixed dataset. The classification models based on CRF and SVM performed well among the classifiers
Disciplines: Ciencias de la computación,
Literatura y lingüística
Keyword: Lingüística aplicada,
Reconocimiento de entidades nombradas,
Mezcla de códigos,
Análisis de textos,
Redes sociales
Keyword: Applied linguistics,
Social networks,
Named entity recognition,
Code mixing,
Text analysis
Full text: Texto completo (Ver HTML) Texto completo (Ver PDF)