How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework

Joanna Schwarzman, Adrian Bauman, Belinda J. Gabbe, Chris Rissel, Trevor Shilton, Ben J. Smith

Research output: Contribution to journalArticlepeer-review

Abstract

The need to improve the practice and quality of evaluation in the health promotion and disease prevention field is widely recognised. In order to plan, implement and evaluate health promotion evaluation capacity building efforts, there is a need to better understand the practitioner, organisational and system-level determinants of evaluation capacity and practice. This study aimed to assess the validity Evaluation Practice Analysis Survey (EPAS) constructs using confirmatory factor analysis and validate a conceptual framework of health promotion evaluation capacity using path analysis. Experienced Australian health promotion practitioners completed the survey (n = 219). Twenty-one of the original 23 EPAS scales were assessed as reliable and valid. The final model was found to have good fit (χ214 = 18.72, p = 0.18, root mean square error of approximation = 0.04, 90% CI 0.00–0.82, Comparative Fit Index = 1.00, standardised root mean square residual = 0.04). This model supports the role of the organisation in facilitating evaluation practice through leadership, culture, systems, support and resources. It builds on existing frameworks from other fields to incorporate political, funding and administrative factors. This study provides an evidence-based model of evaluation capacity that organisations, funders and policy makers can use to plan and implement more effective evaluation capacity building strategies within organisations and the wider prevention field.

Original languageEnglish
Article number102019
Number of pages10
JournalEVALUATION AND PROGRAM PLANNING
Early online date20 Oct 2021
DOIs
Publication statusE-pub ahead of print - 20 Oct 2021
Externally publishedYes

Keywords

  • Confirmatory factor analysis
  • Evaluation capacity
  • Health promotion
  • Path analysis
  • Primary prevention

Fingerprint

Dive into the research topics of 'How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework'. Together they form a unique fingerprint.

Cite this