World Library  
Flag as Inappropriate
Email this Article

Anderson–Darling test

Article Id: WHEBN0003479881
Reproduction Date:

Title: Anderson–Darling test  
Author: World Heritage Encyclopedia
Language: English
Subject: Shapiro–Wilk test, Theodore Wilbur Anderson, Kolmogorov–Smirnov test, List of statistics articles, Statistics
Collection: Nonparametric Statistics, Normality Tests, Statistical Tests
Publisher: World Heritage Encyclopedia

Anderson–Darling test

The Anderson–Darling test is a statistical test of whether a given sample of data is drawn from a given probability distribution. In its basic form, the test assumes that there are no parameters to be estimated in the distribution being tested, in which case the test and its set of critical values is distribution-free. However, the test is most often used in contexts where a family of distributions is being tested, in which case the parameters of that family need to be estimated and account must be taken of this in adjusting either the test-statistic or its critical values. When applied to testing if a normal distribution adequately describes a set of data, it is one of the most powerful statistical tools for detecting most departures from normality.[1][2] K-sample Anderson–Darling tests are available for testing whether several collections of observations can be modelled as coming from a single population, where the distribution function does not have to be specified.

In addition to its use as a test of fit for distributions, it can be used in parameter estimation as the basis for a form of minimum distance estimation procedure.

The test is named after Theodore Wilbur Anderson (born 1918) and Donald A. Darling (born 1915), who invented it in 1952.[3]


  • The single-sample test 1
    • Basic test statistic 1.1
  • Tests for families of distributions 2
    • Test for normality 2.1
    • Tests for other distributions 2.2
  • Non-parametric k-sample tests 3
  • See also 4
  • References 5
  • Further reading 6
  • External links 7

The single-sample test

The Anderson–Darling and Cramér–von Mises statistics belong to the class of quadratic EDF statistics (tests based on the empirical distribution function).[2] If the hypothesized distribution is F, and empirical (sample) cumulative distribution function is F_n, then the quadratic EDF statistics measure the distance between F and F_n by

n \int_{-\infty}^\infty (F_n(x) - F(x))^2\,w(x)\,dF(x),

where w(x) is a weighting function. When the weighting function is w(x)=1, the statistic is the Cramér–von Mises statistic. The Anderson–Darling (1954) test[4] is based on the distance

A = n \int_{-\infty}^\infty \frac{(F_n(x) - F(x))^2}{F(x)\; (1-F(x))} \, dF(x),

which is obtained when the weight function is w(x)=[F(x)\; (1-F(x))]^{-1}. Thus, compared with the Cramér–von Mises distance, the Anderson–Darling distance places more weight on observations in the tails of the distribution.

Basic test statistic

The Anderson–Darling test assesses whether a sample comes from a specified distribution. It makes use of the fact that, when given a hypothesized underlying distribution and assuming the data does arise from this distribution, the frequency of the data can be assumed to follow a Uniform distribution. The data can be then tested for uniformity with a distance test (Shapiro 1980). The formula for the test statistic A to assess if data \{Y_1<\cdots (note that the data must be put in order) comes from a distribution with cumulative distribution function (CDF) \Phi is

A^2 = -n-S \,,


S=\sum_{i=1}^n \frac{2i-1}{n}\left[\ln( \Phi(Y_i)) + \ln\left(1-\Phi(Y_{n+1-i})\right)\right].

The test statistic can then be compared against the critical values of the theoretical distribution. Note that in this case no parameters are estimated in relation to the distribution function \Phi.

Tests for families of distributions

Essentially the same test statistic can be used in the test of fit of a family of distributions, but then it must be compared against the critical values appropriate to that family of theoretical distributions and dependent also on the method used for parameter estimation.

Test for normality

Empirical testing has found[5] that the Anderson–Darling test is not quite as good as Shapiro-Wilk, but is better than other tests. Stephens[1] found A^2 to be one of the best Empirical distribution function statistics for detecting most departures from normality.

The computation differs based on what is known about the distribution:[6]

  • Case 0: The mean \mu and the variance \sigma^2 are both known.
  • Case 1: The variance \sigma^2 is known, but the mean \mu is unknown.
  • Case 2: The mean \mu is known, but the variance \sigma^2 is unknown.
  • Case 3: Both the mean \mu and the variance \sigma^2 are unknown.

The n observations, X_i, for i=1,\ldots n, of the variable X must be sorted such that X_1\leq X_2\leq ... \leq X_n and the notation in the following assumes that Xi represent the ordered observations. Let

\hat{\mu} = \begin{cases} \mu, & \text{if the mean is known.} \\ \bar{X}, = \frac{1}{n} \sum_{i = 1}^n X_i & \text{otherwise.} \end{cases}
\hat{\sigma}^2 = \begin{cases} \sigma^2, & \text{if the variance is known.} \\ \frac{1}{n} \sum_{i = 1}^n (X_i - \mu)^2, & \text{if the variance is not known, but the mean is.} \\ \frac{1}{n - 1} \sum_{i = 1}^n (X_i - \bar{X})^2, & \text{otherwise.} \end{cases}

The values X_i are standardized to create new values Y_i, given by


With the standard normal CDF \Phi, A^2 is calculated using

A^2 = -n -\frac{1}{n} \sum_{i=1}^n (2i-1)(\ln \Phi(Y_i)+ \ln(1-\Phi(Y_{n+1-i}))).

An alternative expression in which only a single observation is dealt with at each step of the summation is:

A^2 = -n -\frac{1}{n} \sum_{i=1}^n\left[(2i-1)\ln\Phi(Y_i)+(2(n-i)+1)\ln(1-\Phi(Y_i))\right].

A modified statistic can be calculated using

A^{*2} = \begin{cases} A^2\left(1+\frac{4}{n}-\frac{25}{n^2}\right), & \text{if the variance and the mean are both unknown.} \\ A^2, & \text{otherwise.} \end{cases}

If A^{2} or A^{*2} exceeds a given critical value, then the hypothesis of normality is rejected with some significance level. The critical values are given in the table below for values of A^{2}.[1]

Note 1: If \hat{\sigma} = 0 or any \Phi(Y_i)=(0 or 1) then A^2 cannot be calculated and is undefined.

Note 2: The above adjustment formula is taken from Shorak & Wellner (1986, p239). Care is required in comparisons across different sources as often the specific adjustment formula is not stated.

Note 3: Stephens[1] notes that the test becomes better when the parameters are computed from the data, even if they are known.

Case n 15% 10% 5% 2.5% 1%
0 \geq 5 1.610 1.933 2.492 3.070 3.857
1 0.908 1.105 1.304 1.573
2 \geq 5 1.760 2.323 2.904 3.690
3 10 0.514 0.578 0.683 0.779 0.926
20 0.528 0.591 0.704 0.815 0.969
50 0.546 0.616 0.735 0.861 1.021
100 0.559 0.631 0.754 0.884 1.047
\infty 0.576 0.656 0.787 0.918 1.092

Alternatively, for case 3 above (both mean and variance unknown), D'Agostino (1986) [6] in Table 4.7 on p. 123 and on pages 372–373 gives the adjusted statistic:

A^{*2}=A^2\left(1+\frac{0.75}{n}+\frac{2.25}{n^2}\right) .

and normality is rejected if A^{*2} exceeds 0.631, 0.752, 0.873, 1.035, or 1.159 at 10%, 5%, 2.5%, 1%, and 0.5% significance levels, respectively; the procedure is valid for sample size at least n=8. The formulas for computing the p-values for other values of A^{*2} are given in Table 4.9 on p. 127 in the same book.

Tests for other distributions

Above, it was assumed that the variable X_i was being tested for normal distribution. Any other family of distributions can be tested but the test for each family is implemented by using a different modification of the basic test statistic and this is referred to critical values specific to that family of distributions. The modifications of the statistic and tables of critical values are given by Stephens (1986)[2] for the exponential, extreme-value, Weibull, gamma, logistic, Cauchy, and von Mises distributions. Tests for the (two-parameter) log-normal distribution can be implemented by transforming the data using a logarithm and using the above test for normality. Details for the required modifications to the test statistic and for the critical values for the normal distribution and the exponential distribution have been published by Pearson & Hartley (1972, Table 54). Details for these distributions, with the addition of the Gumbel distribution, are also given by Shorak & Wellner (1986, p239). Details for the logistic distribution are given by Stephens (1979). A test for the (two parameter) Weibull distribution can be obtained by making use of the fact that the logarithm of a Weibull variate has a Gumbel distribution.

Non-parametric k-sample tests

Fritz Scholz and Michael A. Stephens (1987) discuss a test, based on the Anderson–Darling measure of agreement between distributions, for whether a number of random samples with possibly different sample sizes may have arisen from the same distribution, where this distribution is unspecified.[7] The R package kSamples implements this rank test for comparing k samples among several other such rank tests.[8]

See also


  1. ^ a b c d Stephens, M. A. (1974). "EDF Statistics for Goodness of Fit and Some Comparisons". Journal of the American Statistical Association 69: 730–737.  
  2. ^ a b c M. A. Stephens (1986). "Tests Based on EDF Statistics". In D'Agostino, R. B. and Stephens, M. A. Goodness-of-Fit Techniques. New York: Marcel Dekker.  
  3. ^  
  4. ^ Anderson, T.W. and Darling, D.A. (1954). "A Test of Goodness-of-Fit". Journal of the American Statistical Association 49: 765–769.  
  5. ^ Razali, Nornadiah; Wah, Yap Bee (2011). "Power comparisons of Shapiro–Wilk, Kolmogorov–Smirnov, Lilliefors and Anderson–Darling tests" (PDF). Journal of Statistical Modeling and Analytics 2 (1): 21–33. Retrieved 5 June 2012. 
  6. ^ a b Ralph B. D'Agostino (1986). "Tests for the Normal Distribution". In D'Agostino, R.B. and Stephens, M.A. Goodness-of-Fit Techniques. New York: Marcel Dekker.  
  7. ^ Scholz, F. W.; Stephens, M. A. (1987). "K-sample Anderson–Darling Tests".  
  8. ^ "kSamples: K-Sample Rank Tests and their Combinations". R Project. 

Further reading

  • Corder, G.W., Foreman, D.I. (2009).Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach Wiley, ISBN 978-0-470-45461-9
  • Mehta, S. (2014) Statistics Topics ISBN 978-1499273533
  • Pearson E.S., Hartley, H.O. (Editors) (1972) Biometrika Tables for Statisticians, Volume II. CUP. ISBN 0-521-06937-8.
  • Shapiro, S.S. (1980) How to test normality and other distributional assumptions. In: The ASQC basic references in quality control: statistical techniques 3, pp. 1–78.
  • Shorack, G.R., Wellner, J.A. (1986) Empirical Processes with Applications to Statistics, Wiley. ISBN 0-471-86725-X.
  • Stephens, M.A. (1979) Test of fit for the logistic distribution based on the empirical distribution function, Biometrika, 66(3), 591–5.

External links

  • US NIST Handbook of Statistics
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from World Library are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.