Activities per year
Measuring research impact and effectiveness can support the creation of sustainable responses to systemic or complex healthcare and societal problems. Developing standardised ways to understand and track research impact and effect is a fundamental part of any investigation; particularly within research projects or technological studies that claim to be human-centred, involve health consumers, different stakeholders, end-users or citizens as partners in research (participatory research). However, a lack of standardised and generalisable metrics for evaluating research has been recognised as an important gap for academics and practitioners.
Approach: We created and tested a mixed methods participatory evaluation tool denominated “PROLIFERATE”. In this presentation, we will explore the process of automatizing the tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research projects and their products or outcomes so that these align with end-users’ needs. Besides the easiness of probabilistic interpretation allowed by the Bayesian framework, PROLIFERATE also features a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
Status: The PROLIFERATE tool handles the complexity of evaluation and simplifies it via its new digitised testing, evaluation, and optimisation implementation. A previous version of PROLIFERATE that has been pilot-tested is used as the foundation on which the new digitalised version was conceived. The digitalised modification of PROLIFERATE has received ethics approval (2020/HRE00964) as an ‘End-user evaluation and optimisation plan’ to test/evaluate RAPIDx AI, an artificial intelligence-based decision support health tool, for accurate diagnosis of heart attacks in hospitals.
Conclusion: Participatory research efforts are recognised as excellent accountability and optimization strategies concerning end-user involvement in research and technology development. Based on that principle, we described the new digitalised PROLIFERATE tool and explain how it can measure, track, and predict the impact and effect of AI-powered research technologies/products/programs from the perspective of end-users.
We have automatised and standardised a way to assess the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of research programmes and products according to the perspectives of end-users. We use the AI-powered technology RAPIDx AI to exemplify how PROLIFERATE works.
1. Explore the process of automatizing a tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research.
2. Feature a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
3. Explain how to assess, according to the perspectives of end-users, the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of an artificial intelligence-based decision-support health-tool, for accurate diagnosis of heart attacks in hospitals.
|Publication status||Published - 21 Feb 2022|
|Event||Digital Health Institute Summit - Australia, Melbourne, Australia|
Duration: 20 Feb 2022 → 4 Mar 2022
Conference number: 2
|Conference||Digital Health Institute Summit|
|Period||20/02/22 → 4/03/22|
- Evaluation methodologies
- Digital health
- End User
- clinical trial design
- engagement and impact assessment
- implementation science
- artificial intelligence (AI)
- Artificial Intelligence and Machine Learning in medical practice
FingerprintDive into the research topics of 'PROLIFERATE: A Tool to Measure Impact and Usability of AI-Powered Technologies'. Together they form a unique fingerprint.
Pinero de Plaza, Maria Alejandra (Recipient), 2013
Prize: Honorary award
A winner of the Big Ideas video competition to improve the Australian health system. Consumer Health Forum of Australia, 2021.
Pinero de Plaza, Maria Alejandra (Recipient), 23 Feb 2021
Prize: Other distinctionFile
Maria Alejandra Pinero de Plaza (Speaker)19 Oct 2022
Activity: Talk or presentation types › Invited talk
March KT Conversations - Applying the PROLIFERATE Framework to the REDUCE Missed Oral Healthcare: It Takes a Team Project22 Mar 2021
Activity: Talk or presentation types › Invited talk
Pinero de Plaza, M. A., 30 Mar 2022, In: JBI Evidence Implementation's Bulletin . Issue 1, 1 p.
Research output: Contribution to journal › Comment/debateOpen Access
Consumer engagement in health care policy, research and services: a systematic review and meta-analysis of methods and effectsWiles, L., Kay, D., Luker, J., Worley, A., Austin, J., Ball, A., Bevan, A., Cousins, M., Dalton, S., Hodges, E., Horvat, L., Kerrins, E., Marker, J., McKinnon, M., McMillan, P., Pinero de Plaza, M. A., Smith, J., Yeung, D. & Hillier, S., 27 Jan 2022, In: PLoS One. 17, 1, 26 p., e0261808.
Research output: Contribution to journal › Article › peer-reviewOpen AccessFile9 Citations (Scopus)80 Downloads (Pure)
Cost effectiveness of a 1-hour high-sensitivity troponin-T protocol: An analysis of the RAPID-TnT trialChuang, M. Y. A., Gnanamanickam, E. S., Karnon, J., Lambrakis, K., Horsfall, M., Blyth, A., Seshadri, A., Nguyen, M. T., Briffa, T., Cullen, L. A., Quinn, S., French, J. K. & Chew, D. P., Feb 2022, In: IJC Heart and Vasculature. 38, 8 p., 100933.
Research output: Contribution to journal › Article › peer-reviewOpen AccessFile2 Citations (Scopus)1 Downloads (Pure)