Skip to main content

Statistical significance of variables driving systematic variation in high-dimensional data

Author(s): Chung, Neo Christopher; Storey, John D

To refer to this page use:
Abstract: There are a number of well-established methods such as principal component analysis (PCA) for automatically capturing systematic variation due to latent variables in large-scale genomic data. PCA and related methods may directly provide a quantitative characterization of a complex biological variable that is otherwise difficult to precisely define or model. An unsolved problem in this context is how to systematically identify the genomic variables that are drivers of systematic variation captured by PCA. Principal components (PCs) (and other estimates of systematic variation) are directly constructed from the genomic variables themselves, making measures of statistical significance artificially inflated when using conventional methods due to over-fitting. We introduce a new approach called the jackstraw that allows one to accurately identify genomic variables that are statistically significantly associated with any subset or linear combination of PCs. The proposed method can greatly simplify complex significance testing problems encountered in genomics and can be used to identify the genomic variables significantly associated with latent variables. Using simulation, we demonstrate that our method attains accurate measures of statistical significance over a range of relevant scenarios. We consider yeast cell-cycle gene expression data, and show that the proposed method can be used to straightforwardly identify genes that are cell-cycle regulated with an accurate measure of statistical significance. We also analyze gene expression data from post-trauma patients, allowing the gene expression data to provide a molecularly driven phenotype. Using our method, we find a greater enrichment for inflammatory-related gene sets compared to the original analysis that uses a clinically defined, although likely imprecise, phenotype. The proposed method provides a useful bridge between large-scale quantifications of systematic variation and gene-level significance analyses.
Publication Date: 15-Feb-2015
Electronic Publication Date: 21-Oct-2014
Citation: Chung, Neo Christopher, Storey, John D. (2015). Statistical significance of variables driving systematic variation in high-dimensional data. Bioinformatics, 31 (4), 545 - 554. doi:10.1093/bioinformatics/btu674
DOI: doi:10.1093/bioinformatics/btu674
ISSN: 1367-4803
EISSN: 1460-2059
Pages: 545 - 554
Type of Material: Journal Article
Journal/Proceeding Title: Bioinformatics
Version: Final published version. This is an open access article.

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.