Activities per year
Measuring research impact and effectiveness can support the creation of sustainable responses to systemic or complex healthcare and societal problems. Developing standardised ways to understand and track research impact and effect is a fundamental part of any investigation; particularly within research projects or technological studies that claim to be human-centred, involve health consumers, different stakeholders, end-users or citizens as partners in research (participatory research). However, a lack of standardised and generalisable metrics for evaluating research has been recognised as an important gap for academics and practitioners.
Approach: We created and tested a mixed methods participatory evaluation tool denominated “PROLIFERATE”. In this presentation, we will explore the process of automatizing the tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research projects and their products or outcomes so that these align with end-users’ needs. Besides the easiness of probabilistic interpretation allowed by the Bayesian framework, PROLIFERATE also features a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
Status: The PROLIFERATE tool handles the complexity of evaluation and simplifies it via its new digitised testing, evaluation, and optimisation implementation. A previous version of PROLIFERATE that has been pilot-tested is used as the foundation on which the new digitalised version was conceived. The digitalised modification of PROLIFERATE has received ethics approval (2020/HRE00964) as an ‘End-user evaluation and optimisation plan’ to test/evaluate RAPIDx AI, an artificial intelligence-based decision support health tool, for accurate diagnosis of heart attacks in hospitals.
Conclusion: Participatory research efforts are recognised as excellent accountability and optimization strategies concerning end-user involvement in research and technology development. Based on that principle, we described the new digitalised PROLIFERATE tool and explain how it can measure, track, and predict the impact and effect of AI-powered research technologies/products/programs from the perspective of end-users.
We have automatised and standardised a way to assess the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of research programmes and products according to the perspectives of end-users. We use the AI-powered technology RAPIDx AI to exemplify how PROLIFERATE works.
1. Explore the process of automatizing a tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research.
2. Feature a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
3. Explain how to assess, according to the perspectives of end-users, the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of an artificial intelligence-based decision-support health-tool, for accurate diagnosis of heart attacks in hospitals.
|Publication status||Published - 21 Feb 2022|
|Event||Digital Health Institute Summit - Australia, Melbourne, Australia|
Duration: 20 Feb 2022 → 4 Mar 2022
Conference number: 2
|Conference||Digital Health Institute Summit|
|Period||20/02/22 → 4/03/22|
- Evaluation methodologies
- Digital health
- End User
- clinical trial design
- engagement and impact assessment
- implementation science
- artificial intelligence (AI)
- Artificial Intelligence and Machine Learning in medical practice
FingerprintDive into the research topics of 'PROLIFERATE: A Tool to Measure Impact and Usability of AI-Powered Technologies'. Together they form a unique fingerprint.
Pinero de Plaza, Maria Alejandra (Recipient), 2013
Prize: Honorary award
A winner of the Big Ideas video competition to improve the Australian health system. Consumer Health Forum of Australia, 2021.
Pinero de Plaza, Maria Alejandra (Recipient), 23 Feb 2021
Prize: Other distinctionFile
Maria Alejandra Pinero de Plaza (Speaker)23 May 2023
Activity: Talk or presentation types › Invited talkFile
Maria Alejandra Pinero de Plaza (Speaker)19 Oct 2022
Activity: Talk or presentation types › Invited talk
Co-designing, measuring, and optimizing innovations and solutions within complex adaptive health systemsPinero de Plaza, M. A., Yadav, L. & Kitson, A., 31 Mar 2023, In: Frontiers in Health Services. 3, 18 p., 1154614.
Research output: Contribution to journal › Article › peer-reviewOpen AccessFile21 Downloads (Pure)
PROLIFERATE_AI: A prediction modeling method to evaluate Artificial Intelligence in meeting end-user-centric goals around better cardiac carePinero de Plaza, M. A., Lambrakis, K., Marmolejo-Ramos, F., Beleigoli, A., Clark, R., McMillan, P., Morton, E., Khan, E., Visvanathan, R., Chew, D., Kitson, A., Hendriks, J. & Barrera-Causil, C., 5 Aug 2023, In: Heart, Lung and Circulation. 32, Supplement 3, p. S364-S365 2 p.
Research output: Contribution to journal › Meeting Abstract › peer-review
The Use of Digital Technologies in the Inpatient Setting to Promote Communication During the Early Stage of an Infectious Disease Outbreak: A Scoping ReviewMudd, A., Feo, R., Pinero de Plaza, M. A., Tieu, M., Paia, S. Y., Cleland, J., Windle, A., George, S., Thompson, M. Q., Ambagtsheer, R. C., Muller, A., Hall, A. & Lange, B., 1 Feb 2023, In: Telemedicine and e-Health. 29, 2, p. 172-197 26 p.
Research output: Contribution to journal › Review article › peer-review