login

Expectation-Maximization as lower bound maximization

Published 1 January 1998
Thomas P. Minka
Citations90

TL;DR

This note derives EM from the lower bounding viewpoint Luttrell which better illustrates the convergence properties of the Expectation Maximization algorithm and its variants.

Abstract

The Expectation-Maximization algorithm given by Dempster et al (1977) has enjoyed considerable popularity for solving MAP estimation problems. This note derives EM from the lower bounding viewpoint (Luttrell, 1994), which better illustrates the convergence properties of the algorithm and its variants. The algorithm is illustrated with two examples: pooling data from multiple noisy sources and tting a mixture density. 1

Keywords

Computer Science