Interlude: Inference Techniques and Sampling

From Church Wiki

Jump to: navigation, search
To return to the top level: Language Models Tutorial.

enumeration isn't possible, unless it is and recognizing when it is in fact possible is interesting and useful. sampling is always applicable, unless it isn't, because the samplers we build come with basically zero guarantees about their performance

Contents

Exact Sampling

The simplest kind

Rejection Sampling

Importance Sampling

Particle Filtering: Sequential Importance Sampling

Adaptive Importance Sampling

Annealed Importance Sampling

MCMC

Gibbs Sampling

Metropolis Hastings

Psychological Plausibility of Sampling as Inference

Personal tools