DOE OSTI · 1022903
A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation using First-Order Logic
Abstract
Topic models have been used successfully for a variety of problems, often in the form of application-specific extensions of the basic Latent Dirichlet Allocation (LDA) model. Because deriving these new models in order to encode domain knowledge can be difficult and time-consuming, we propose the Fold-all model, which allows the user to specify general domain knowledge in First-Order Logic (FOL). However, combining topic modeling with FOL can result in inference problems beyond the capabilities of existing techniques. We have therefore developed a scalable inference technique using stochastic gradient descent which may also be useful to the Markov Logic Network (MLN) research community. Experiments demonstrate the expressive power of Fold-all, as well as the scalability of our proposed inference method.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Andrzejewski, D, Zhu, X, Craven, M, Recht, B. 2011-01-18. A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation using First-Order Logic. https://searchnasa.com/record/osti%3A1022903/a-framework-for-incorporating-general-domain-knowledge-into-latent-dirichlet-allocation-using-first
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.