scholarly journals Biostatistics for Multiple Testing

2020 ◽  
Vol 63 (3) ◽  
pp. 97-100
Author(s):  
Jeong-Seok Choi
Keyword(s):  
False Discovery Rate ◽  
Error Rate ◽  
Null Hypothesis ◽  
Multiple Testing ◽  
Statistical Techniques ◽  
Testing Hypotheses ◽  
Family Wise Error Rate ◽  
False Discovery ◽  
The Family ◽  
True Null Hypotheses

Multiple testings are instances that contain simultaneous tests for more than one hypothesis. When multiple testings are conducted at the same time, it is more likely that the null hypothesis is rejected, even if the null hypothesis is correct. If individual hypothesis decisions are based on unadjusted <i>p</i>-values, it is usually more likely that some of the true null hypotheses will be rejected. In order to solve the multiple testing problems, various studies have attempted to increase the power by taking into account the family-wise error rate or false discovery rate and statistics required for testing hypotheses. This article discuss methods that account for the multiplicity issue and introduces various statistical techniques.

Optimized multi-stage designs controlling the false discovery or the family-wise error rate

2008 ◽  
Vol 27 (21) ◽  
pp. 4145-4160 ◽  
Author(s):  
Sonja Zehetmayer ◽  
Peter Bauer ◽  
Martin Posch
Keyword(s):  
Error Rate ◽  
Family Wise Error Rate ◽  
False Discovery ◽  
Multi Stage ◽  
The Family

scholarly journals Multiple Testing. Part II. Step-Down Procedures for Control of the Family-Wise Error Rate

2004 ◽  
Vol 3 (1) ◽  
pp. 1-33 ◽  
Author(s):  
Mark J. van der Laan ◽  
Sandrine Dudoit ◽  
Katherine S. Pollard
Keyword(s):  
Error Rate ◽  
Multiple Testing ◽  
Type I Error ◽  
Null Distribution ◽  
Type I ◽  
Test Statistics ◽  
P Values ◽  
Family Wise Error Rate ◽  
The Family ◽  
Step Down

The present article proposes two step-down multiple testing procedures for asymptotic control of the family-wise error rate (FWER): the first procedure is based on maxima of test statistics (step-down maxT), while the second relies on minima of unadjusted p-values (step-down minP). A key feature of our approach is the characterization and construction of a test statistics null distribution (rather than data generating null distribution) for deriving cut-offs for these test statistics (i.e., rejection regions) and the resulting adjusted p-values. For general null hypotheses, corresponding to submodels for the data generating distribution, we identify an asymptotic domination condition for a null distribution under which the step-down maxT and minP procedures asymptotically control the Type I error rate, for arbitrary data generating distributions, without the need for conditions such as subset pivotality. Inspired by this general characterization, we then propose as an explicit null distribution the asymptotic distribution of the vector of null value shifted and scaled test statistics. Step-down procedures based on consistent estimators of the null distribution are shown to also provide asymptotic control of the Type I error rate. A general bootstrap algorithm is supplied to conveniently obtain consistent estimators of the null distribution.

scholarly journals Confidence maps: statistical inference of cryo-EM maps

2020 ◽  
Vol 76 (4) ◽  
pp. 332-339
Author(s):  
Maximilian Beckers ◽  
Colin M. Palmer ◽  
Carsten Sachse
Keyword(s):  
Error Rate ◽  
Background Noise ◽  
Statistical Significance ◽  
Complementary Information ◽  
Family Wise Error Rate ◽  
False Discovery ◽  
The Family ◽  
Current Article ◽  
Practical Guidance ◽  
Level Of Significance

Confidence maps provide complementary information for interpreting cryo-EM densities as they indicate statistical significance with respect to background noise. They can be thresholded by specifying the expected false-discovery rate (FDR), and the displayed volume shows the parts of the map that have the corresponding level of significance. Here, the basic statistical concepts of confidence maps are reviewed and practical guidance is provided for their interpretation and usage inside the CCP-EM suite. Limitations of the approach are discussed and extensions towards other error criteria such as the family-wise error rate are presented. The observed map features can be rendered at a common isosurface threshold, which is particularly beneficial for the interpretation of weak and noisy densities. In the current article, a practical guide is provided to the recommended usage of confidence maps.

scholarly journals A region-based multiple testing method for hypotheses ordered in space or time

2015 ◽  
Vol 14 (1) ◽  
pp. 1-19 ◽  
Author(s):  
Rosa J. Meijer ◽  
Thijmen J.P. Krebs ◽  
Jelle J. Goeman
Keyword(s):  
Error Rate ◽  
Null Hypothesis ◽  
Multiple Testing ◽  
Testing Procedure ◽  
Familywise Error Rate ◽  
Expected Number ◽  
Multiple Testing Procedure ◽  
Exact Location ◽  
Testing Method

AbstractWe present a multiple testing method for hypotheses that are ordered in space or time. Given such hypotheses, the elementary hypotheses as well as regions of consecutive hypotheses are of interest. These region hypotheses not only have intrinsic meaning but testing them also has the advantage that (potentially small) signals across a region are combined in one test. Because the expected number and length of potentially interesting regions are usually not available beforehand, we propose a method that tests all possible region hypotheses as well as all individual hypotheses in a single multiple testing procedure that controls the familywise error rate. We start at testing the global null-hypothesis and when this hypothesis can be rejected we continue with further specifying the exact location/locations of the effect present. The method is implemented in the

Application of the False Discovery Rate to Quantitative Trait Loci Interval Mapping With Multiple Traits

Genetics ◽  
2002 ◽  
Vol 161 (2) ◽  
pp. 905-914 ◽  
Author(s):  
Hakkyo Lee ◽  
Jack C M Dekkers ◽  
M Soller ◽  
Massoud Malek ◽  
Rohan L Fernando ◽  
...  
Keyword(s):  
Quantitative Trait Loci ◽  
False Discovery Rate ◽  
Error Rate ◽  
Quantitative Trait ◽  
Interval Mapping ◽  
Error Rates ◽  
Multiple Traits ◽  
Test Statistic ◽  
False Discovery ◽  
Trait Loci

Abstract Controlling the false discovery rate (FDR) has been proposed as an alternative to controlling the genomewise error rate (GWER) for detecting quantitative trait loci (QTL) in genome scans. The objective here was to implement FDR in the context of regression interval mapping for multiple traits. Data on five traits from an F2 swine breed cross were used. FDR was implemented using tests at every 1 cM (FDR1) and using tests with the highest test statistic for each marker interval (FDRm). For the latter, a method was developed to predict comparison-wise error rates. At low error rates, FDR1 behaved erratically; FDRm was more stable but gave similar significance thresholds and number of QTL detected. At the same error rate, methods to control FDR gave less stringent significance thresholds and more QTL detected than methods to control GWER. Although testing across traits had limited impact on FDR, single-trait testing was recommended because there is no theoretical reason to pool tests across traits for FDR. FDR based on FDRm was recommended for QTL detection in interval mapping because it provides significance tests that are meaningful, yet not overly stringent, such that a more complete picture of QTL is revealed.

On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics

2000 ◽  
Vol 25 (1) ◽  
pp. 60-83 ◽  
Author(s):  
Yoav Benjamini ◽  
Yosef Hochberg
Keyword(s):  
False Discovery Rate ◽  
Multiple Testing ◽  
Meta Analysis ◽  
Test Statistics ◽  
Adaptive Procedure ◽  
New Approach ◽  
False Discovery ◽  
Behavioral Studies ◽  
Simultaneous Testing ◽  
Independent Test

A new approach to problems of multiple significance testing was presented in Benjamini and Hochberg (1995), which calls for controlling the expected ratio of the number of erroneous rejections to the number of rejections–the False Discovery Rate (FDR). The procedure given there was shown to control the FDR for independent test statistics. When some of the hypotheses are in fact false, that procedure is too conservative. We present here an adaptive procedure, where the number of true null hypotheses is estimated first as in Hochberg and Benjamini (1990), and this estimate is used in the procedure of Benjamini and Hochberg (1995). The result is still a simple stepwise procedure, to which we also give a graphical companion. The new procedure is used in several examples drawn from educational and behavioral studies, addressing problems in multi-center studies, subset analysis and meta-analysis. The examples vary in the number of hypotheses tested, and the implication of the new procedure on the conclusions. In a large simulation study of independent test statistics the adaptive procedure is shown to control the FDR and have substantially better power than the previously suggested FDR controlling method, which by itself is more powerful than the traditional family wise error-rate controlling methods. In cases where most of the tested hypotheses are far from being true there is hardly any penalty due to the simultaneous testing of many hypotheses.

scholarly journals Multiplicity- and dependency-adjusted p-values for control of the family-wise error rate

2016 ◽  
Vol 111 ◽  
pp. 32-40 ◽  
Author(s):  
Jens Stange ◽  
Thorsten Dickhaus ◽  
Arcadi Navarro ◽  
Daniel Schunk
Keyword(s):  
Error Rate ◽  
P Values ◽  
Family Wise Error Rate ◽  
The Family
Sign in / Sign up

Export Citation Format

Share Document