World Library  
Flag as Inappropriate
Email this Article

Statistical theory

Article Id: WHEBN0000027579
Reproduction Date:

Title: Statistical theory  
Author: World Heritage Encyclopedia
Language: English
Subject: Optimal design, Sampling (statistics), Statistics, High-dimensional statistics, U-statistic
Collection: Statistical Theory
Publisher: World Heritage Encyclopedia

Statistical theory

The theory of statistics provides a basis for the whole range of techniques, in both study design and data analysis, that are used within applications of statistics.[1][2] The theory covers approaches to statistical-decision problems and to statistical inference, and the actions and deductions that satisfy the basic principles stated for these different approaches. Within a given approach, statistical theory gives ways of comparing statistical procedures; it can find a best possible procedure within a given context for given statistical problems, or can provide guidance on the choice between alternative procedures.[2][3]

Apart from philosophical considerations about how to make statistical inferences and decisions, much of statistical theory consists of mathematical statistics, and is closely linked to probability theory, to utility theory, and to optimization.


  • Scope 1
    • Modelling 1.1
    • Data collection 1.2
    • Summarising data 1.3
    • Interpreting data 1.4
    • Applied statistical inference 1.5
  • See also 2
  • Notes 3
  • References 4
  • Further reading 5


Statistical theory provides an underlying rationale and provides a consistent basis for the choice of methodology used in applied statistics.


Statistical models describe the sources of data and can have different types of formulation corresponding to these sources and to the problem being studied. Such problems can be of various kinds:

Statistical models, once specified, can be tested to see whether they provide useful inferences for new data sets.[4] Testing a hypothesis using the data that was used to specify the model is a fallacy, according to the natural science of Bacon and the scientific method of Peirce.

Data collection

Statistical theory provides a guide to comparing methods of data collection, where the problem is to generate informative data using optimization and randomization while measuring and controlling for observational error.[5][6][7] Optimization of data collection reduces the cost of data while satisfying statistical goals,[8][9] while randomization allows reliable inferences. Statistical theory provides a basis for good data collection and the structuring of investigations in the topics of:

Summarising data

The task of summarising statistical data in conventional forms (also known as descriptive statistics) is considered in theoretical statistics as a problem of defining what aspects of statistical samples need to be described and how well they can be described from a typically limited sample of data. Thus the problems theoretical statistics considers include:

  • Choosing summary statistics to describe a sample
  • Summarising probability distributions of sample data while making limited assumptions about the form of distribution that may be met
  • Summarising the relationships between different quantities measured on the same items with a sample

Interpreting data

Besides the philosophy underlying statistical inference, statistical theory has the task of considering the types of questions that data analysts might want to ask about the problems they are studying and of providing data analytic techniques for answering them. Some of these tasks are:

  • Summarising populations in the form of a fitted distribution or probability density function
  • Summarising the relationship between variables using some type of regression analysis
  • Providing ways of predicting the outcome of a random quantity given other related variables
  • Examining the possibility of reducing the number of variables being considered within a problem (the task of Dimension reduction)

When a statistical procedure has been specified in the study protocol, then statistical theory provides well-defined probability statements for the method when applied to all populations that could have arisen from the randomization used to generate the data. This provides an objective way of estimating parameters, estimating confidence intervals, testing hypotheses, and selecting the best. Even for observational data, statistical theory provides a way of calculating a value that can be used to interpret a sample of data from a population, it can provide a means of indicating how well that value is determined by the sample, and thus a means of saying corresponding values derived for different populations are as different as they might seem; however, the reliability of inferences from post-hoc observational data is often worse than for planned randomized generation of data.

Applied statistical inference

Statistical theory provides the basis for a number of data analytic methods that are common across scientific and social research. Some of these are: Interpreting data is an important objective of statistical research:

Many of the standard methods for these tasks rely on certain statistical assumptions (made in the derivation of the methodology) actually holding in practice. Statistical theory studies the consequences of departures from these assumptions. In addition it provides a range of robust statistical techniques that are less dependent on assumptions, and it provides methods checking whether particular assumptions are reasonable for a give data-set.

See also


  1. ^ Cox & Hinkley (1974, p.1)
  2. ^ a b  
  3. ^  
  4. ^  
  5. ^
  6. ^  
  7. ^  
  8. ^ a b Atkinson, A. C.; Donev, A. N.; Tobias, R. D. (2007). Optimum Experimental Designs, with SAS. Oxford University Press. pp. 511+xvi.  
  9. ^  
  10. ^ Hinkelmann and Kempthorne (2008)
  11. ^ Bailey (2008).
  12. ^ Kish (1965)
  13. ^  
  14. ^ Särndal, Carl-Erik, Swensson, Bengt, and Wretman, Jan (1992). Model Assisted Survey Sampling. Springer-Verlag.  


  • Bailey, R. A (2008). Design of Comparative Experiments. Cambridge University Press.   Pre-publication chapters are available on-line.
  • Cox, D.R., Hinkley, D.V. (1974) Theoretical Statistics, Chapman & Hall. ISBN 0-412-12420-3
  • Hinkelmann, Klaus and  
  • Kish, L. (1965), Survey Sampling, Wiley. ISBN 0-471-48900-X

Further reading

  • Peirce, C. S.
    • (1876), "Note on the Theory of the Economy of Research" in Coast Survey Report, pp. 197–201 (Appendix No. 14), NOAA PDF Eprint. Reprinted 1958 in Collected Papers of Charles Sanders Peirce 7, paragraphs 139–157 and in 1967 in Operations Research 15 (4): pp. 643–648, Abstract from JSTOR.
    • (1967) Peirce, C. S. (1967). "Note on the Theory of the Economy of Research". Operations Research 15 (4): 643.  
    • (1877–1878), "Illustrations of the Logic of Science"
    • (1883), "A Theory of Probable Inference"
    • and Jastrow, Joseph (1885), "On Small Differences in Sensation" in Memoirs of the National Academy of Sciences 3: pp. 73–83. Eprint.

  • Atkinson, A. C.; Donev, A. N.; Tobias, R. D. (2007). Optimum Experimental Designs, with SAS. Oxford University Press. pp. 511+xvi.  
  • Bickel, Peter J. and Doksum, Kjell A. (2001). Mathematical Statistics: Basic and Selected Topics I (Second (updated printing 2007) ed.). Pearson Prentice-Hall.  
  • Davison, A.C. (2003) Statistical Models. Cambridge University Press. ISBN 0-521-77339-3
  • Liese, Friedrich and Miescke, Klaus-J. (2008). Statistical Decision Theory: Estimation, Testing, and Selection. Springer.  
  • Särndal, Carl-Erik, Swensson, Bengt, and Wretman, Jan (1992). Model Assisted Survey Sampling. Springer-Verlag.  
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from World Library are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.