Header

UZH-Logo

Maintenance Infos

Balanced control of generalized error rates


Romano, Joseph P; Wolf, Michael (2010). Balanced control of generalized error rates. Annals of Statistics, 38(1):598-633.

Abstract

Consider the problem of testing s hypotheses simultaneously. In this paper, we derive methods which control the generalized family-wise error rate given by the probability of k or more false rejections, abbreviated k-FWER. We derive both single-step and step-down procedures that control the k-FWER in finite samples or asymptotically, depending on the situation. Moreover, the procedures are asymptotically balanced in an appropriate sense. We briefly consider control of the average number of false rejections. Additionally, we consider the false discovery proportion (FDP), defined as the number of false rejections divided by the total number of rejections (and defined to be 0 if there are no rejections). Here, the goal is to construct methods which satisfy, for given γ and α, P{FDP>γ}≤α, at least asymptotically. Special attention is paid to the construction of methods which implicitly take into account the dependence structure of the individual test statistics in order to further increase the ability to detect false null hypotheses. A general resampling and subsampling approach is presented which achieves these objectives, at least asymptotically.

Abstract

Consider the problem of testing s hypotheses simultaneously. In this paper, we derive methods which control the generalized family-wise error rate given by the probability of k or more false rejections, abbreviated k-FWER. We derive both single-step and step-down procedures that control the k-FWER in finite samples or asymptotically, depending on the situation. Moreover, the procedures are asymptotically balanced in an appropriate sense. We briefly consider control of the average number of false rejections. Additionally, we consider the false discovery proportion (FDP), defined as the number of false rejections divided by the total number of rejections (and defined to be 0 if there are no rejections). Here, the goal is to construct methods which satisfy, for given γ and α, P{FDP>γ}≤α, at least asymptotically. Special attention is paid to the construction of methods which implicitly take into account the dependence structure of the individual test statistics in order to further increase the ability to detect false null hypotheses. A general resampling and subsampling approach is presented which achieves these objectives, at least asymptotically.

Statistics

Citations

Dimensions.ai Metrics
18 citations in Web of Science®
16 citations in Scopus®
25 citations in Microsoft Academic
Google Scholar™

Altmetrics

Downloads

67 downloads since deposited on 01 Feb 2010
9 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Economics
Dewey Decimal Classification:330 Economics
Language:English
Date:2010
Deposited On:01 Feb 2010 12:23
Last Modified:17 Feb 2018 16:53
Publisher:Institute of Mathematical Statistics
ISSN:0090-5364
OA Status:Hybrid
Publisher DOI:https://doi.org/10.1214/09-AOS734

Download

Download PDF  'Balanced control of generalized error rates'.
Preview
Filetype: PDF (Working Paper version)
Size: 1MB
View at publisher