139 AI-based risk predictions: Evaluation of pilot DRAAI 5 Fidelity and Timeliness All admissions during the 8-week pilot period received daily updated risk predictions from DRAAI. A total of 428 admissions were included in the analysis to assess the follow-up of the risk predictions, generating 2,246 risk predictions. Among these, 128 admissions (30%) had at least one at-risk prediction during their stay. In terms of fidelity, nearly 80 percent (79%; 101/128) of the at-risk predictions were followed-up by nurses with the creation of a nursing care plan. Additionally, for 22% of the at-risk predictions, a nursing care plan had already been created before DRAAI issued an at-risk prediction. For instance, a patient admitted on August 3rd at 15:00 might have had a nursing care plan created at 17:00, while the first DRAAI prediction on the morning of August 4th flagged the patient at-risk. In 72% (21/29) of such cases the first DRAAI prediction for the admission flagged at-risk as well. Timeliness of follow-up showed that for 65% of patients, a nursing care plan was created within 48 hours of the first at-risk prediction, as shown in Table 4. Table 4 Fidelity and timeliness concerning the follow-up of the risk predictions Description of the outcome Number of admissions Percentage Number of admissions that received daily predictions from DRAAI 428 100% Fidelity Number of admissions in which there was at least one at (high) risk prediction from DRAAI 128 100% A nursing care plan was created 101 78.9% Number of admissions where there was never at (high) risk in DRAAI 300 100% No at (high) risk prediction from DRAAI, a nursing care plan was created based on clinical reasoning/other risk assessment was performed 43 14.3% Timeliness 128 100% Nursing care plan created prior to at (high) risk prediction from DRAAI 29 22.7% Nursing care plan created within 24 hours of at (high) risk prediction from DRAAI 40 31.3% Nursing care plan created between 24 and 48 hours of first at (high) risk prediction from DRAAI 14 10.9% Nursing care plan created later than 48 hours of first at (high) risk prediction from DRAAI 18 14.1% Never created a nursing care plan 27 21.0%
RkJQdWJsaXNoZXIy MTk4NDMw