| Journal: | Computación y Sistemas |
| Database: | PERIÓDICA |
| System number: | 000457248 |
| ISSN: | 1405-5546 |
| Authors: | Parida, Shantipriya1 Bojar, Ondřej1 Dash, Satya Ranjan2 |
| Institutions: | 1Charles University, Faculty of Mathematics and Physics, Praga. República Checa 2Kalinga Institute of Industrial Technology, School of Computer Application, Orissa. India |
| Year: | 2019 |
| Season: | Oct-Dic |
| Volumen: | 23 |
| Number: | 4 |
| Pages: | 1499-1505 |
| Country: | México |
| Language: | Inglés |
| Document type: | Artículo |
| Approach: | Aplicado, descriptivo |
| English abstract | Visual Genome is a dataset connecting structured image information with English language. We present "Hindi Visual Genome", a multi-modal dataset consisting of text and images suitable for English-Hindi multi-modal machine translation task and multi-modal research. We have selected short English segments (captions) from Visual Genome along with the associated images and automatically translated them to Hindi. A careful manual post-editing followed which took the associated images into account. Overall, we prepared a set of 31,525 segments (which we conveniently split into training, development and test data), accompanied by a challenge test set of 1,400 segments. This challenge test set was created by searching for particularly ambiguous English words based on the embedding similarity and manually selecting those where the image helps to resolve the ambiguity. Our dataset is the first manually revised dataset for multi-modal English-Hindi machine translation, freely available for non-commercial research purposes. Our Hindi version of Visual Genome also allows to create Hindi image labelers or other practical tools. Hindi Visual Genome also served in Workshop on Asian Translation (WAT) 2019 Multi-Modal Translation Task |
| Disciplines: | Ciencias de la computación |
| Keyword: | Inteligencia artificial, Procesamiento de datos, Programación, Genoma, Visualización, Corpus multimodal, Corpus paralelo, Incrustaciones, Traducción automática, Procesamiento de imágenes |
| Keyword: | Artificial intelligence, Data processing, Programming, Genome, Visualization, Multi-modal corpus, Parallel corpus, Embeddings, Machine translation, Image processing |
| Full text: | Texto completo (Ver HTML) Texto completo (Ver PDF) |
