| Journal: | Computación y sistemas |
| Database: | |
| System number: | 000560639 |
| ISSN: | 1405-5546 |
| Authors: | Martínez Guzmán, Gerardo1 Bernábe Loranca, María Beatriz1 Cerón Garnica, Carmen1 Serrano Pérez, Jonathan1 Archundia Sierra, Etelvina1 |
| Institutions: | 1Benemérita Universidad Autónoma de Puebla, Facultad de Ciencias de la Computación, México |
| Year: | 2022 |
| Season: | Ene-Mar |
| Volumen: | 26 |
| Number: | 1 |
| Pages: | 281-293 |
| Country: | México |
| Language: | Inglés |
| English abstract | A fundamental problem in text analysis of great amount of information is to discover the topics described in the documents. One of the most useful application involves the extraction of topics from documents corpus. Such is the case of Wikicorpus that consists of approximately 250,000 documents totaling in 250 millions of words. In this work, a system based on the Latent Dirichlet Allocation (LDA) model has been developed to carry out the task of automatically selecting the words of the corpus and, based on their frequency in the documents, it would indicate that they may or not belong to certain topic, classifying words without human intervention. Due to the large amount of information of the corpus, a Serial-Parallel Algorithm (SPA) in C/C++ and OpenMP have been used to perform parallel programming, since in parallel stages all threads must share certain variables, so the design architecture was shared memory. |
| Keyword: | Corpus, Generative model, Dirichlet distribution, Latent topics, Parallelization, Algorithm, C/C++ programming |
| Full text: | Texto completo (Ver HTML) Texto completo (Ver PDF) |
