Work

Some investigations into energy-based models

Year: 2007
Type: dissertation
Abstract: Three questions about various energy-based probability models are asked and answered. The first is whether the Contrastive Divergence algorithm computes the gradient of any function at all---the answer is no. The second is whether there is a tractable Monte Carlo approximation to the gradient for variational learning in a large class of models including Sigmoid Belief Networks---the answer is yes. The third is how we might do early stopping for Restricted Boltzmann Machines, which have intractable objective functions---the problem is studied thoroughly, some old algorithms are reviewed and some new and better ones are introduced, and the way is pointed to the ultimate algorithm for this problem.
Language: English
Open Access status: green
OpenAlex ID: W91813857
Cites: 10
Cited by: 4
Related to: 10