Activities per year
Abstract
Measuring research impact and effectiveness can support the creation of sustainable responses to systemic or complex healthcare and societal problems. Developing standardised ways to understand and track research impact and effect is a fundamental part of any investigation; particularly within research projects or technological studies that claim to be human-centred, involve health consumers, different stakeholders, end-users or citizens as partners in research (participatory research). However, a lack of standardised and generalisable metrics for evaluating research has been recognised as an important gap for academics and practitioners.
Approach: We created and tested a mixed methods participatory evaluation tool denominated “PROLIFERATE”. In this presentation, we will explore the process of automatizing the tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research projects and their products or outcomes so that these align with end-users’ needs. Besides the easiness of probabilistic interpretation allowed by the Bayesian framework, PROLIFERATE also features a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
Status: The PROLIFERATE tool handles the complexity of evaluation and simplifies it via its new digitised testing, evaluation, and optimisation implementation. A previous version of PROLIFERATE that has been pilot-tested is used as the foundation on which the new digitalised version was conceived. The digitalised modification of PROLIFERATE has received ethics approval (2020/HRE00964) as an ‘End-user evaluation and optimisation plan’ to test/evaluate RAPIDx AI, an artificial intelligence-based decision support health tool, for accurate diagnosis of heart attacks in hospitals.
Conclusion: Participatory research efforts are recognised as excellent accountability and optimization strategies concerning end-user involvement in research and technology development. Based on that principle, we described the new digitalised PROLIFERATE tool and explain how it can measure, track, and predict the impact and effect of AI-powered research technologies/products/programs from the perspective of end-users.
We have automatised and standardised a way to assess the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of research programmes and products according to the perspectives of end-users. We use the AI-powered technology RAPIDx AI to exemplify how PROLIFERATE works.
Learning objectives:
1. Explore the process of automatizing a tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research.
2. Feature a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
3. Explain how to assess, according to the perspectives of end-users, the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of an artificial intelligence-based decision-support health-tool, for accurate diagnosis of heart attacks in hospitals.
Original language | English |
---|---|
Pages | 1 |
Publication status | Published - 21 Feb 2022 |
Event | Digital Health Institute Summit - Australia, Melbourne, Australia Duration: 20 Feb 2022 → 4 Mar 2022 Conference number: 2 https://digitalhealth.org.au/institute-summit-melbourne/speakers/# |
Conference
Conference | Digital Health Institute Summit |
---|---|
Abbreviated title | DHIS2022 |
Country/Territory | Australia |
City | Melbourne |
Period | 20/02/22 → 4/03/22 |
Internet address |
Keywords
- Evaluation methodologies
- Digital health
- End User
- clinical trial design
- engagement and impact assessment
- implementation science
- artificial intelligence (AI)
- Artificial Intelligence and Machine Learning in medical practice
Fingerprint
Dive into the research topics of 'PROLIFERATE: A Tool to Measure Impact and Usability of AI-Powered Technologies'. Together they form a unique fingerprint.Prizes
-
Australian Postgraduate Award, Deakin University, AU. 2013-2014
Pinero de Plaza, Maria Alejandra (Recipient), 2013
Prize: Honorary award
-
A winner of the Big Ideas video competition to improve the Australian health system. Consumer Health Forum of Australia, 2021.
Pinero de Plaza, Maria Alejandra (Recipient), 23 Feb 2021
Prize: Other distinction
File -
The Vice-President & Executive Dean’s Awards 2021
Pinero de Plaza, Maria Alejandra (Recipient), 14 Dec 2021
Prize
File
-
CLINICA SUMMIT 2022
Alejandra Pinero de Plaza (Participant)
21 Feb 2022Activity: Participating in or organising an event types › Participating in a conference, workshop, ...
-
New Ways to Solve Complex Problems and PROLIFERATE
Maria Alejandra Pinero de Plaza (Speaker)
19 Oct 2022Activity: Talk or presentation types › Invited talk
-
March KT Conversations - Applying the PROLIFERATE Framework to the REDUCE Missed Oral Healthcare: It Takes a Team Project
Alejandra Pinero de Plaza (Keynote speaker), Joanne Murray (Speaker), Sarah Hunter (Speaker) & Constance Kourbelis (Speaker)
22 Mar 2021Activity: Talk or presentation types › Invited talk
-
A transdisciplinary research program addressing complex health research problems
Pinero de Plaza, M. A., 30 Mar 2022, In: JBI Evidence Implementation's Bulletin . Issue 1, 1 p.Research output: Contribution to journal › Comment/debate
Open Access -
Consumer engagement in health care policy, research and services: a systematic review and meta-analysis of methods and effects
Wiles, L., Kay, D., Luker, J., Worley, A., Austin, J., Ball, A., Bevan, A., Cousins, M., Dalton, S., Hodges, E., Horvat, L., Kerrins, E., Marker, J., McKinnon, M., McMillan, P., Pinero de Plaza, M. A., Smith, J., Yeung, D. & Hillier, S., 27 Jan 2022, In: PLoS One. 17, 1, 26 p., e0261808.Research output: Contribution to journal › Article › peer-review
Open AccessFile9 Citations (Scopus)80 Downloads (Pure) -
Cost effectiveness of a 1-hour high-sensitivity troponin-T protocol: An analysis of the RAPID-TnT trial
Chuang, M. Y. A., Gnanamanickam, E. S., Karnon, J., Lambrakis, K., Horsfall, M., Blyth, A., Seshadri, A., Nguyen, M. T., Briffa, T., Cullen, L. A., Quinn, S., French, J. K. & Chew, D. P., Feb 2022, In: IJC Heart and Vasculature. 38, 8 p., 100933.Research output: Contribution to journal › Article › peer-review
Open AccessFile2 Citations (Scopus)1 Downloads (Pure)