Mode estimation for high dimensional discrete tree graphical models

Abstract

This paper studies the following problem: given samples from a high dimensional discrete distribution, we want to estimate the leading (δ,ρ)-modes of the underlying distributions. A point is defined to be a (δ,ρ)-mode if it is a local optimum of the density within a δ-neighborhood under metric ρ. As we increase the scale'' parameter δ, the neighborhood size increases and the total number of modes monotonically decreases. The sequence of the (δ,ρ)-modes reveal intrinsic topographical information of the underlying distributions. Though the mode finding problem is generally intractable in high dimensions, this paper unveils that, if the distribution can be approximated well by a tree graphical model, mode characterization is significantly easier. An efficient algorithm with provable theoretical guarantees is proposed and is applied to applications like data analysis and multiple predictions.