TY - JOUR
T1 - Human-centred AI for emergency cardiac care
T2 - Evaluating RAPIDx AI with PROLIFERATE_AI
AU - Pinero de Plaza, Maria Alejandra
AU - Lambrakis, Kristina
AU - Marmolejo-Ramos, Fernando
AU - Beleigoli, Alline
AU - Archibald, Mandy
AU - Yadav, Lalit
AU - McMillan, Penelope
AU - Clark, Robyn
AU - Lawless, Michael
AU - Morton, Erin
AU - Hendriks, Jeroen
AU - Kitson, Alison
AU - Visvanathan, Renuka
AU - Chew, Derek P.
AU - Barrera Causil, Carlos Javier
N1 - Publisher Copyright:
© 2025 The Author(s)
PY - 2025/4/1
Y1 - 2025/4/1
N2 - Background: Chest pain diagnosis in emergency care is hindered by overlapping cardiac and non-cardiac symptoms, causing diagnostic uncertainty. Artificial Intelligence, such as RAPIDx AI, aims to enhance accuracy through clinical and biochemical data integration, but its adoption relies on addressing usability, explainability, and seamless workflow integration without disrupting care. Objective: Evaluate RAPIDx AI's integration into clinical workflows, address usability barriers, and optimise its adoption in emergencies. Methods: The PROLIFERATE_AI framework was implemented across 12 EDs (July 2022–January 2024) with 39 participants: 15 experts co-designed a survey via Expert Knowledge Elicitation (EKE), applied to 24 ED clinicians to assess RAPIDx AI usability and adoption. Bayesian inference, using priors, estimated comprehension, emotional engagement, usage, and preference, while Monte Carlo simulations quantified uncertainty and variability, generating posterior means and 95% bootstrapped confidence intervals. Qualitative thematic analysis identified barriers and optimisation needs, with data triangulated through the PROLIFERATE_AI scoring system to rate RAPIDx AI's performance by user roles and demographics. Results: Registrars exhibited the highest comprehension (median: 0.466, 95 % CI: 0.41–0.51) and preference (median: 0.458, 95 % CI: 0.41–0.48), while residents/interns scored the lowest in comprehension (median: 0.198, 95 % CI: 0.17–0.26) and emotional engagement (median: 0.112, 95 % CI: 0.09–0.14). Registered nurses showed strong emotional engagement (median: 0.379, 95 % CI: 0.35–0.45). Novice users faced usability and workflow integration barriers, while experienced clinicians suggested automation and streamlined workflows. RAPIDx AI scored “Good Impact,” excelling with trained users but requiring targeted refinements for novices. Conclusion: RAPIDx AI enhances diagnostic accuracy and efficiency for experienced users, but usability challenges for novices highlight the need for targeted training and interface refinements. The PROLIFERATE_AI framework offers a robust methodology for evaluating and scaling AI solutions, addressing the evolving needs of sociotechnical systems.
AB - Background: Chest pain diagnosis in emergency care is hindered by overlapping cardiac and non-cardiac symptoms, causing diagnostic uncertainty. Artificial Intelligence, such as RAPIDx AI, aims to enhance accuracy through clinical and biochemical data integration, but its adoption relies on addressing usability, explainability, and seamless workflow integration without disrupting care. Objective: Evaluate RAPIDx AI's integration into clinical workflows, address usability barriers, and optimise its adoption in emergencies. Methods: The PROLIFERATE_AI framework was implemented across 12 EDs (July 2022–January 2024) with 39 participants: 15 experts co-designed a survey via Expert Knowledge Elicitation (EKE), applied to 24 ED clinicians to assess RAPIDx AI usability and adoption. Bayesian inference, using priors, estimated comprehension, emotional engagement, usage, and preference, while Monte Carlo simulations quantified uncertainty and variability, generating posterior means and 95% bootstrapped confidence intervals. Qualitative thematic analysis identified barriers and optimisation needs, with data triangulated through the PROLIFERATE_AI scoring system to rate RAPIDx AI's performance by user roles and demographics. Results: Registrars exhibited the highest comprehension (median: 0.466, 95 % CI: 0.41–0.51) and preference (median: 0.458, 95 % CI: 0.41–0.48), while residents/interns scored the lowest in comprehension (median: 0.198, 95 % CI: 0.17–0.26) and emotional engagement (median: 0.112, 95 % CI: 0.09–0.14). Registered nurses showed strong emotional engagement (median: 0.379, 95 % CI: 0.35–0.45). Novice users faced usability and workflow integration barriers, while experienced clinicians suggested automation and streamlined workflows. RAPIDx AI scored “Good Impact,” excelling with trained users but requiring targeted refinements for novices. Conclusion: RAPIDx AI enhances diagnostic accuracy and efficiency for experienced users, but usability challenges for novices highlight the need for targeted training and interface refinements. The PROLIFERATE_AI framework offers a robust methodology for evaluating and scaling AI solutions, addressing the evolving needs of sociotechnical systems.
KW - Adoption
KW - Artificial intelligence
KW - Cardiac biomarkers
KW - Decision support
KW - Emergency medicine
KW - Human-centred evaluation
KW - Usability
U2 - 10.1016/j.ijmedinf.2025.105810
DO - 10.1016/j.ijmedinf.2025.105810
M3 - Article
SN - 1386-5056
VL - 196
JO - International Journal of Medical Informatics
JF - International Journal of Medical Informatics
M1 - 105810
ER -