Penn Arts & Sciences Logo

Probability and Combinatorics

Tuesday, March 3, 2020 - 3:00pm

Jonathan Niles-Weed

Courant

Location

University of Pennsylvania

David Rittenhouse Lab 4C8

We propose a new statistical model, generalizing the spiked covariance model, which formalizes the assumption that two probability distributions differ only on a low-dimensional subspace. We study various probabilistic and statistical features of this model, including the estimation of the Wasserstein distance, which we show can be accomplished by an estimator which avoids the "curse of dimensionality" typically present in high-dimensional problems involving the Wasserstein distance. However, this estimator does not seem possible to compute in polynomial time, and we give evidence that any computationally efficient estimator is bound to suffer from the curse of dimensionality. Our results therefore suggest the existence of a computational-statistical gap.

Joint work with Philippe Rigollet.