Skip to main content

Significance Level

Significance level

A method to describe the reliability of test results.

When researchers measure a behavior, they often compare groups to determine whether they differ on that behavior. The ultimate goal is to determine whether the difference would occur if the measurements were administered a second time, or whether the difference is accidental and not likely to recur. The degree of reliability relates to the concept of significance level. The significance level refers to how likely it is that an error (that is, a wrong decision about whether the groups differ from one another) would be made. Psychologists generally accept a 5 percent error rate as reasonable. In order to decide whether differences are reliable, psychologists conduct statistical tests that provide a measure of confidence in their conclusions. This area of statistics is called inferential statistics because psychologists draw inferences, or conclusions, about what would happen if they made similar measurements with a different set of subjects.

If two similar groups are being measured, then they will produce different scores even though the difference is not particularly meaningful. If a researcher measures how much time students in separate mathematics classes take to solve a similar problem, the average for those two classes is likely to differ somewhat, even if the two classes consist of students with comparable abilities

Further Reading

Berman, Simeon M. Mathematical Statistics: An Introduction Based on the Normal Distribution. Scranton, PA: Intext Educational Publishers, 1971.

Christensen, Larry B. Experimental Methodology, 5th ed. Boston: Allyn and Bacon, 1991.

D'Amato, M. R. Experimental Psychology: Methodology, Psychophysics, and Learning. New York: McGraw-Hill, 1970

Elmes, David G. Research Methods in Psychology, 4th ed. St. Paul: West Publishing Company, 1992.

Kantowitz, Barry H. Experimental Psychology: Understanding Psychological Research, 5th ed. St. Paul: West Publishing Company, 1994.

Martin, David W. Doing Psychology Experiments, 2nd ed. Monterey, CA: Brooks/Cole, 1985.

Cite this article
Pick a style below, and copy the text for your bibliography.

  • MLA
  • Chicago
  • APA

"Significance Level." Gale Encyclopedia of Psychology. . Encyclopedia.com. 16 Nov. 2018 <https://www.encyclopedia.com>.

"Significance Level." Gale Encyclopedia of Psychology. . Encyclopedia.com. (November 16, 2018). https://www.encyclopedia.com/medicine/encyclopedias-almanacs-transcripts-and-maps/significance-level

"Significance Level." Gale Encyclopedia of Psychology. . Retrieved November 16, 2018 from Encyclopedia.com: https://www.encyclopedia.com/medicine/encyclopedias-almanacs-transcripts-and-maps/significance-level

Learn more about citation styles

Citation styles

Encyclopedia.com gives you the ability to cite reference entries and articles according to common styles from the Modern Language Association (MLA), The Chicago Manual of Style, and the American Psychological Association (APA).

Within the “Cite this article” tool, pick a style to see how all available information looks when formatted according to that style. Then, copy and paste the text into your bibliography or works cited list.

Because each style has its own formatting nuances that evolve over time and not all information is available for every reference entry or article, Encyclopedia.com cannot guarantee each citation it generates. Therefore, it’s best to use Encyclopedia.com citations as a starting point before checking the style against your school or publication’s requirements and the most-recent information available at these sites:

Modern Language Association

http://www.mla.org/style

The Chicago Manual of Style

http://www.chicagomanualofstyle.org/tools_citationguide.html

American Psychological Association

http://apastyle.apa.org/

Notes:
  • Most online reference entries and articles do not have page numbers. Therefore, that information is unavailable for most Encyclopedia.com content. However, the date of retrieval is often important. Refer to each style’s convention regarding the best way to format page numbers and retrieval dates.
  • In addition to the MLA, Chicago, and APA styles, your school, university, publication, or institution may have its own requirements for citations. Therefore, be sure to refer to those guidelines when editing your bibliography or works cited list.