Accounting for complexity in critical realist trials: the promise of PLS-SEM

Heidi Singleton, Sam Porter, John Beavis, Liz Falconer, Jacqueline Priego-Hernandez, Debbie Holley

Research output: Contribution to journalArticlepeer-review

36 Downloads (Pure)

Abstract

Background: Randomized controlled trials have been criticized for their inability to identify and differentiate the causal mechanisms that generate the outcomes they measure. One posited solution is the development of realist trials that combine the empirical precision of trials’ outcome data with realism’s theoretical capacity to identify the powers that generate outcomes.

Main Body: We review realist arguments for and against this position and conclude that critical realist trials are viable. Using the example of an evaluation of the educational effectiveness of virtual reality simulation, we explore whether Partial Least Squares Structural Equation Modelling can move statistical analysis beyond correlational analysis to support realist identification of the mechanisms that generate correlations.

Conclusion: We tentatively conclude that PLS-SEM, with its ability to identify ‘points of action’, has the potential to provide direction for researchers and practitioners in terms of how, for whom, when, where and in what circumstances an intervention has worked.
Original languageEnglish
Number of pages20
JournalJournal of Critical Realism
Early online date22 Jun 2023
DOIs
Publication statusEarly online - 22 Jun 2023

Keywords

  • RCT
  • critical realist evaluation
  • critical realism
  • causality
  • PLS-SEM

Cite this