Skip to main content

Bootstrap Method

Bootstrap Method

BIBLIOGRAPHY

The bootstrap method, introduced by Bradley Efron (1979, 1982), is a technique for making statistical inference. In the typical estimation scenario, one draws a sample Y =[y1, , yn ] from an unknown distribution F and then computes an estimate θ = g (Y) of some parameter or quantity θ that is of interest. If the distribution of (θ θ ) were known, it would be straightforward to find values c1, c2 such that

for some small value of α, say 0.1 or 0.05. Rearranging terms inside the parentheses results in a confidence interval, θ c2 θ θ c1, for the quantity θ. The distribution of (θ θ ) is unknown in most situations, however. In some cases, the finite-sample distribution of (θ θ ) can be approximated by the limiting distribution, but this may not work well in some cases.

The bootstrap method is based on the idea of replicating the estimation scenario described above by drawing B samples from an estimate F of F and computing estimates , b =1 , B. Given the B values , it is straightforward to find values c1*, c2* such that

by finding appropriate percentiles of the differences Substituting the values into (1) yields

Rearranging terms inside the parentheses in (3) yields an estimated confidence interval

Here, confidence intervals have been estimated based on the differences but other approaches may also be used (see Efron and Tibshirani [1993] for examples). The approximation in (2) is due to the fact that B must be finite, while the approximation in (3) is due to the fact that the original estimate θ is based on a finite sample of size n; the first approximation improves as B , and the second approximation improves as n

Variants of the bootstrap method also differ according to how the bootstrap samples Y* are constructed. In the naive bootstrap, Y* is constructed by drawing from the empirical distribution of the original data Y. This approach works in the sense of yielding estimated confidence intervals with correct coverages whenever the limiting distribution of θ is normal, as proved by Enno Mammen (1992). However, the naive bootstrap often fails in other situations (see Bickel and Freedman [1981] for examples). In cases where data are bounded, constructing bootstrap samples by drawing from a smooth estimate of F, rather than the empirical distribution function, often yields confidence intervals with correct coverages; this approach is called a smooth bootstrap. The smooth bootstrap has been used with data envelopment analysis (DEA) estimators to estimate confidence intervals for measures of technical efficiency (see Simar and Wilson [1998, 2000] for details).

The bootstrap method has been increasingly used as computers have become faster and cheaper. It is particularly useful in situations where limiting distributions involve unknown parameters that may be difficult to estimate, which is often the case with nonparametric estimators such as DEA. The method is also useful in situations where limiting normal distributions provide poor approximations to finite-sample distributions of estimators. By constructing bootstrap samples by drawing from either the empirical distribution or a smooth estimate of the distribution of the original data, the bootstrap method incorporates information about higher moments (e.g., skewness, kurtosis, etc.) that is ignored when limiting normal distributions are used to approximate finite sample distributions. This sometimes leads to bootstrap confidence interval estimates with better coverage properties than more conventional confidence interval estimates.

SEE ALSO Data Envelopment Analysis; Econometric Decomposition; Frequency Distributions

BIBLIOGRAPHY

Bickel, Peter J., and David A. Freedman. 1981. Some Asymptotic Theory for the Bootstrap. Annals of Statistics 9: 11961217.

Efron, Bradley. 1979. Bootstrap Methods: Another Look at the Jackknife. Annals of Statistics 7: 116.

Efron, Bradley. 1982. The Jackknife, the Bootstrap, and Other Resampling Plans. Philadelphia: Society for Industrial and Applied Mathematics.

Efron, Bradley, and Robert J. Tibshirani. 1993. An Introduction to the Bootstrap. London: Chapman and Hall.

Mammen, Enno. 1992. When Does Bootstrap Work? Asymptotic Results and Simulations. Berlin and New York: Springer-Verlag.

Simar, Léopold, and Paul W. Wilson. 1998. Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models. Management Science 44: 4961.

Simar, Léopold, and Paul W. Wilson. 2000. A General Methodology for Bootstrapping in Non-parametric Frontier Models. Journal of Applied Statistics 27: 779802.

Paul W. Wilson

Cite this article
Pick a style below, and copy the text for your bibliography.

  • MLA
  • Chicago
  • APA

"Bootstrap Method." International Encyclopedia of the Social Sciences. . Encyclopedia.com. 16 Nov. 2018 <https://www.encyclopedia.com>.

"Bootstrap Method." International Encyclopedia of the Social Sciences. . Encyclopedia.com. (November 16, 2018). https://www.encyclopedia.com/social-sciences/applied-and-social-sciences-magazines/bootstrap-method

"Bootstrap Method." International Encyclopedia of the Social Sciences. . Retrieved November 16, 2018 from Encyclopedia.com: https://www.encyclopedia.com/social-sciences/applied-and-social-sciences-magazines/bootstrap-method

Learn more about citation styles

Citation styles

Encyclopedia.com gives you the ability to cite reference entries and articles according to common styles from the Modern Language Association (MLA), The Chicago Manual of Style, and the American Psychological Association (APA).

Within the “Cite this article” tool, pick a style to see how all available information looks when formatted according to that style. Then, copy and paste the text into your bibliography or works cited list.

Because each style has its own formatting nuances that evolve over time and not all information is available for every reference entry or article, Encyclopedia.com cannot guarantee each citation it generates. Therefore, it’s best to use Encyclopedia.com citations as a starting point before checking the style against your school or publication’s requirements and the most-recent information available at these sites:

Modern Language Association

http://www.mla.org/style

The Chicago Manual of Style

http://www.chicagomanualofstyle.org/tools_citationguide.html

American Psychological Association

http://apastyle.apa.org/

Notes:
  • Most online reference entries and articles do not have page numbers. Therefore, that information is unavailable for most Encyclopedia.com content. However, the date of retrieval is often important. Refer to each style’s convention regarding the best way to format page numbers and retrieval dates.
  • In addition to the MLA, Chicago, and APA styles, your school, university, publication, or institution may have its own requirements for citations. Therefore, be sure to refer to those guidelines when editing your bibliography or works cited list.