Abstract
Background: Randomized controlled trials have been criticized for their inability to identify and differentiate the causal mechanisms that generate the outcomes they measure. One posited solution is the development of realist trials that combine the empirical precision of trials’ outcome data with realism’s theoretical capacity to identify the powers that generate outcomes.
Main Body: We review realist arguments for and against this position and conclude that critical realist trials are viable. Using the example of an evaluation of the educational effectiveness of virtual reality simulation, we explore whether Partial Least Squares Structural Equation Modelling can move statistical analysis beyond correlational analysis to support realist identification of the mechanisms that generate correlations.
Conclusion: We tentatively conclude that PLS-SEM, with its ability to identify ‘points of action’, has the potential to provide direction for researchers and practitioners in terms of how, for whom, when, where and in what circumstances an intervention has worked.
Main Body: We review realist arguments for and against this position and conclude that critical realist trials are viable. Using the example of an evaluation of the educational effectiveness of virtual reality simulation, we explore whether Partial Least Squares Structural Equation Modelling can move statistical analysis beyond correlational analysis to support realist identification of the mechanisms that generate correlations.
Conclusion: We tentatively conclude that PLS-SEM, with its ability to identify ‘points of action’, has the potential to provide direction for researchers and practitioners in terms of how, for whom, when, where and in what circumstances an intervention has worked.
Original language | English |
---|---|
Number of pages | 20 |
Journal | Journal of Critical Realism |
Early online date | 22 Jun 2023 |
DOIs | |
Publication status | Early online - 22 Jun 2023 |
Keywords
- RCT
- critical realist evaluation
- critical realism
- causality
- PLS-SEM