Misunderstandings and omissions in textbook accounts of effect sizes

Research output: Contribution to journalArticlepeer-review

229 Downloads (Pure)

Abstract

There have been frequent attempts in psychology to reduce the reliance on null hypothesis significance testing (NHST) as the criterion for establishing the importance of results. Many authorities now recommend the reporting of effect sizes (ESs) as a supplement or alternative to NHST. However, there is extensive specialist literature highlighting problems associated with the use and interpretation of ESs. A review of the coverage of ESs in over 100 textbooks on statistical analysis in behavioural science revealed widespread neglect of ESs and the relevant critical issues that have widespread coverage in the more specialist literature. For example, many textbooks claim that ESs should be interpreted as a simple measure of the practical real-world importance of a result despite the fact that ESs are profoundly influenced by features of design and analysis strategy. We seek to highlight areas of misunderstanding about ESs found in the pedagogical literature in the light of the more specialist literature and make recommendations to researchers for the appropriate use and interpretation of ESs. This is critical as statistics textbooks have a crucial role in the education of researchers.
Original languageEnglish
Number of pages16
JournalBritish Journal of Psychology
Early online date4 Jun 2019
DOIs
Publication statusEarly online - 4 Jun 2019

Keywords

  • effect size
  • methodology
  • null hypothesis significance testing
  • statistical reporting
  • textbooks
  • the new statistics

Fingerprint

Dive into the research topics of 'Misunderstandings and omissions in textbook accounts of effect sizes'. Together they form a unique fingerprint.

Cite this