A Study on Stochastic Variational Inference for Topic Modeling with Word Embeddings



Document title: A Study on Stochastic Variational Inference for Topic Modeling with Word Embeddings
Journal: Computación y sistemas
Database:
System number: 000560732
ISSN: 1405-5546
Authors: 1
1
Institutions: 1Ochanomizu University, Kanto. Japón
Year:
Season: Jul-Sep
Volumen: 26
Number: 3
Pages: 1225-1232
Country: México
Language: Inglés
English abstract Probabilistic topic models based on Latent Dirichlet Allocation (LDA) is widely used to extract latent topics from document collections. In recent years, a number of extended topic models have been proposed, especially Gaussian LDA (G-LDA) has attracted a lot of attention. G-LDA integrates topic modeling with word embeddings by replacing discrete topic distributions over words with multivariate Gaussian distributions on the word embedding space. This can reflect semantic information into topics. In this paper, we use G-LDA for our base topic model and apply Stochastic Variational Inference (SVI), an efficient inference algorithm, to estimate topics. Through experiments, we could extract the topics with high coherence in practical time.
Keyword: Topic model,
Latent Dirichlet allocation,
Word embeddings,
Stochastic variational inference
Full text: Texto completo (Ver HTML) Texto completo (Ver PDF)