Activities per year
Abstract
Measuring research impact and effectiveness can support the creation of sustainable responses to systemic or complex healthcare and societal problems. Developing standardised ways to understand and track research impact and effect is a fundamental part of any investigation; particularly within research projects or technological studies that claim to be human-centred, involve health consumers, different stakeholders, end-users or citizens as partners in research (participatory research). However, a lack of standardised and generalisable metrics for evaluating research has been recognised as an important gap for academics and practitioners.
Approach: We created and tested a mixed methods participatory evaluation tool denominated “PROLIFERATE”. In this presentation, we will explore the process of automatizing the tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research projects and their products or outcomes so that these align with end-users’ needs. Besides the easiness of probabilistic interpretation allowed by the Bayesian framework, PROLIFERATE also features a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
Status: The PROLIFERATE tool handles the complexity of evaluation and simplifies it via its new digitised testing, evaluation, and optimisation implementation. A previous version of PROLIFERATE that has been pilot-tested is used as the foundation on which the new digitalised version was conceived. The digitalised modification of PROLIFERATE has received ethics approval (2020/HRE00964) as an ‘End-user evaluation and optimisation plan’ to test/evaluate RAPIDx AI, an artificial intelligence-based decision support health tool, for accurate diagnosis of heart attacks in hospitals.
Conclusion: Participatory research efforts are recognised as excellent accountability and optimization strategies concerning end-user involvement in research and technology development. Based on that principle, we described the new digitalised PROLIFERATE tool and explain how it can measure, track, and predict the impact and effect of AI-powered research technologies/products/programs from the perspective of end-users.
We have automatised and standardised a way to assess the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of research programmes and products according to the perspectives of end-users. We use the AI-powered technology RAPIDx AI to exemplify how PROLIFERATE works.
Learning objectives:
1. Explore the process of automatizing a tool, as a computerised technique that can measure, track, and predict, via cutting-edge Bayesian methods, the effectiveness and impact of participatory research.
2. Feature a Bayesian approach to extract knowledge from users and translate it in a probabilistic format suitable for prediction modelling.
3. Explain how to assess, according to the perspectives of end-users, the comprehensibility, emotional resonance, motivation to change, barriers and future accessibility of an artificial intelligence-based decision-support health-tool, for accurate diagnosis of heart attacks in hospitals.
Original language | English |
---|---|
Pages | 1 |
Publication status | Published - 21 Feb 2022 |
Event | Digital Health Institute Summit - Australia, Melbourne, Australia Duration: 20 Feb 2022 → 4 Mar 2022 Conference number: 2 https://digitalhealth.org.au/institute-summit-melbourne/speakers/# |
Conference
Conference | Digital Health Institute Summit |
---|---|
Abbreviated title | DHIS2022 |
Country/Territory | Australia |
City | Melbourne |
Period | 20/02/22 → 4/03/22 |
Internet address |
Keywords
- Evaluation methodologies
- Digital health
- End User
- clinical trial design
- engagement and impact assessment
- implementation science
- artificial intelligence (AI)
- Artificial Intelligence and Machine Learning in medical practice
Fingerprint
Dive into the research topics of 'PROLIFERATE: A Tool to Measure Impact and Usability of AI-Powered Technologies'. Together they form a unique fingerprint.Prizes
-
Australian Postgraduate Award, Deakin University, AU. 2013-2014
Pinero de Plaza, Maria Alejandra (Recipient), 2013
Prize: Honorary award
-
A winner of the Big Ideas video competition to improve the Australian health system. Consumer Health Forum of Australia, 2021.
Pinero de Plaza, Maria Alejandra (Recipient), 23 Feb 2021
Prize: Other distinction
File -
The Vice-President & Executive Dean’s Awards 2021
Pinero de Plaza, Maria Alejandra (Recipient), 14 Dec 2021
Prize
File
-
How can research, advocacy, and innovation come together to improve digital health for better care?
Maria Alejandra Pinero de Plaza (Speaker)
23 May 2023Activity: Talk or presentation types › Invited talk
File -
CLINICA SUMMIT 2022
Alejandra Pinero de Plaza (Participant)
21 Feb 2022Activity: Participating in or organising an event types › Participating in a conference, workshop, ...
-
New Ways to Solve Complex Problems and PROLIFERATE
Maria Alejandra Pinero de Plaza (Speaker)
19 Oct 2022Activity: Talk or presentation types › Invited talk
-
Co-designing, measuring, and optimizing innovations and solutions within complex adaptive health systems
Pinero de Plaza, M. A., Yadav, L. & Kitson, A., 31 Mar 2023, In: Frontiers in Health Services. 3, 18 p., 1154614.Research output: Contribution to journal › Article › peer-review
Open AccessFile21 Downloads (Pure) -
PROLIFERATE_AI: A prediction modeling method to evaluate Artificial Intelligence in meeting end-user-centric goals around better cardiac care
Pinero de Plaza, M. A., Lambrakis, K., Marmolejo-Ramos, F., Beleigoli, A., Clark, R., McMillan, P., Morton, E., Khan, E., Visvanathan, R., Chew, D., Kitson, A., Hendriks, J. & Barrera-Causil, C., 5 Aug 2023, In: Heart, Lung and Circulation. 32, Supplement 3, p. S364-S365 2 p.Research output: Contribution to journal › Meeting Abstract › peer-review
-
The Use of Digital Technologies in the Inpatient Setting to Promote Communication During the Early Stage of an Infectious Disease Outbreak: A Scoping Review
Mudd, A., Feo, R., Pinero de Plaza, M. A., Tieu, M., Paia, S. Y., Cleland, J., Windle, A., George, S., Thompson, M. Q., Ambagtsheer, R. C., Muller, A., Hall, A. & Lange, B., 1 Feb 2023, In: Telemedicine and e-Health. 29, 2, p. 172-197 26 p.Research output: Contribution to journal › Review article › peer-review