Skip to main content

Lipschitz Density-Ratios, Structured Data, and Data-driven Tuning

Author(s): Kpotufe, S

To refer to this page use:
Full metadata record
DC FieldValueLanguage
dc.contributor.authorKpotufe, S-
dc.identifier.citationKpotufe, Samory. "Lipschitz density-ratios, structured data, and data-driven tuning." In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLR 54, pp. 1320-1328. 2017.en_US
dc.description.abstractDensity-ratio estimation (i.e. estimating f=fQ/fP for two unknown distributions Q and P) has proved useful in many Machine Learning tasks, e.g., risk-calibration in transfer-learning, two-sample tests, and also useful in common techniques such importance sampling and bias correction. While there are many important analyses of this estimation problem, the present paper derives convergence rates in other practical settings that are less understood, namely, extensions of traditional Lipschitz smoothness conditions, and common high-dimensional settings with structured data (e.g. manifold data, sparse data). Various interesting facts, which hold in earlier settings, are shown to extend to these settings. Namely, (1) optimal rates depend only on the smoothness of the ratio f, and not on the densities fQ, fP, supporting the belief that plugging in estimates for fQ, fP is suboptimal; (2) optimal rates depend only on the intrinsic dimension of data, i.e. this problem – unlike density estimation – escapes the curse of dimension. We further show that near-optimal rates are attainable by estimators tuned from data alone, i.e. with no prior distributional information. This last fact is of special interest in unsupervised settings such as this one, where only oracle rates seem to be known, i.e., rates which assume critical distributional information usually unavailable in practice.en_US
dc.relation.ispartofProceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLRen_US
dc.relation.ispartofseriesProceedings of Machine Learning Research;-
dc.rightsFinal published version. Article is made available in OAR by the publisher's permission or policy.en_US
dc.titleLipschitz Density-Ratios, Structured Data, and Data-driven Tuningen_US
dc.typeConference Articleen_US

Files in This Item:
File Description SizeFormat 
LipschitzDensityRatioDataTuning.pdf634.58 kBAdobe PDFView/Download

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.