When assessing generalisability, focusing on differences in population or setting alone is insufficient.

Helen ED Burchett ORCID logo; Dylan Kneale; Laurence Blanchard ORCID logo; James Thomas; (2020) When assessing generalisability, focusing on differences in population or setting alone is insufficient. Trials, 21 (1). 286-. DOI: 10.1186/s13063-020-4178-6
Copy

Generalisability is typically only briefly mentioned in discussion sections of evaluation articles, which are unhelpful in judging whether an intervention could be implemented elsewhere, with similar effects. Several tools to assess generalisability exist, but they are difficult to operationalise and are rarely used. We believe a different approach is needed. Instead of focusing on similarities (or more likely, differences) in generic population and setting characteristics, generalisability assessments should focus on understanding an intervention's mechanism of action - why or how an intervention was effective. We believe changes are needed to four types of research. First, outcome evaluations should draw on programme theory. Second, process evaluations should aim to understand interventions' mechanism of action, rather than simply 'what happened'. Third, small scoping studies should be conducted in new settings, to explore how to enact identified mechanisms. Finally, innovative synthesis methods are required, in order to identify mechanisms of action where there is a lack of existing process evaluations.


picture_as_pdf
Burchett_et_al-2020-Trials.pdf
subject
Published Version
Available under Creative Commons: 3.0

View Download

Atom BibTeX OpenURL ContextObject in Span Multiline CSV OpenURL ContextObject Dublin Core Dublin Core MPEG-21 DIDL EndNote HTML Citation JSON MARC (ASCII) MARC (ISO 2709) METS MODS RDF+N3 RDF+N-Triples RDF+XML RIOXX2 XML Reference Manager Refer Simple Metadata ASCII Citation EP3 XML
Export

Downloads