ePrints Repository

All evidence is equal: the flaw in statistical reasoning

Gorard, Stephen (2010) All evidence is equal: the flaw in statistical reasoning. Oxford Review of Education, 36 (1). pp. 63-77. ISSN 0305-4985

PDF (76Kb)

URL of Published Version: http://www.informaworld.com/smpp/content~db=all~content=a919321904

Identification Number/DOI: 10.1080/03054980903518928

In the context of existing ‘quantitative’/’qualitative’ schisms, this paper briefly reminds readers of the current practice of testing for statistical significance in social science research. This practice is based on a widespread confusion between two conditional probabilities. A worked example and other elements of logical argument demonstrate the flaw in statistical testing as currently conducted, even when strict protocols are met. Assessment of significance cannot be standardised and requires knowledge of an underlying figure that the analyst does not generally have and can not usually know. Therefore, even if all assumptions are met, the practice of statistical testing in isolation is futile. The question many people then ask in consequence is - what should we do instead? This is, perhaps, the wrong question. Rather, the question could be – why should we expect to treat randomly sampled figures differently from any other kinds of numbers, or any other forms of evidence? What we could do ‘instead’ is use figures in the same way as we would most other data, with care and judgement. If all such evidence is equal, the implications for research synthesis and the way we generate new knowledge are considerable

Type of Work:Article
Date:01 February 2010 (Publication)
School/Faculty:Colleges (2008 onwards) > College of Social Sciences
Department:School of Education
Subjects:L Education (General)
Institution:University of Birmingham
Copyright Holders:Taylor & Francis
ID Code:295
Local Holdings:
Export Reference As : ASCII + BibTeX + Dublin Core + EndNote + HTML + METS + MODS + OpenURL Object + Reference Manager + Refer + RefWorks
Share this item :
QR Code for this page

Repository Staff Only: item control page