Skip to main content

Variational Inference in Nonconjugate Models

Author(s): Wang, Chong; Blei, David M

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr1dc1f
Full metadata record
DC FieldValueLanguage
dc.contributor.authorWang, Chong-
dc.contributor.authorBlei, David M-
dc.date.accessioned2021-10-08T19:44:21Z-
dc.date.available2021-10-08T19:44:21Z-
dc.date.issued2013en_US
dc.identifier.citationWang, Chong, and David M. Blei. "Variational Inference in Nonconjugate Models." Journal of Machine Learning Research 14 (2013): pp. 1005-1031.en_US
dc.identifier.issn1532-4435-
dc.identifier.issn1533-7928-
dc.identifier.urihttp://www.jmlr.org/papers/v14/wang13b.html-
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr1dc1f-
dc.description.abstractMean-field variational methods are widely used for approximate posterior inference in many probabilistic models. In a typical application, mean-field methods approximately compute the posterior with a coordinate-ascent optimization algorithm. When the model is conditionally conjugate, the coordinate updates are easily derived and in closed form. However, many models of interest---like the correlated topic model and Bayesian logistic regression---are nonconjugate. In these models, mean-field methods cannot be directly applied and practitioners have had to develop variational algorithms on a case-by-case basis. In this paper, we develop two generic methods for nonconjugate models, Laplace variational inference and delta method variational inference. Our methods have several advantages: they allow for easily derived variational algorithms with a wide class of nonconjugate models; they extend and unify some of the existing algorithms that have been derived for specific models; and they work well on real-world data sets. We studied our methods on the correlated topic model, Bayesian logistic regression, and hierarchical Bayesian logistic regression.en_US
dc.format.extent1005 - 1031en_US
dc.language.isoen_USen_US
dc.relation.ispartofJournal of Machine Learning Researchen_US
dc.rightsFinal published version. Article is made available in OAR by the publisher's permission or policy.en_US
dc.titleVariational Inference in Nonconjugate Modelsen_US
dc.typeJournal Articleen_US
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/journal-articleen_US

Files in This Item:
File Description SizeFormat 
VariationalInferenceNonconjugateModel.pdf488.33 kBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.