Skip to content
Artificial intelligence. Clearly. RSS feed
AI NEWS AI

News. Evidence. Perspective.

ResearchAnalysis

An AI patient improved clinicians’ serious-illness communication scores

In a 51-person randomized trial, 30 minutes with SOPHIE improved patient-actor conversation scores more than matched reading. The advantage was measured immediately after training.

Thirty minutes with a virtual patient helped medical trainees and clinicians handle a simulated serious-illness conversation better than thirty minutes of reading. In a 51-person randomized trial published in JMIR Medical Education on 20 October, SOPHIE produced an additional 0.09 improvement on a communication scale running from zero to one. The trial assessed what participants said to patient-actors after training, providing evidence of an observable skill change.[1]

The University of Rochester study enrolled medical, nursing and physician-assistant students alongside practising clinicians. Its focus was a difficult teaching problem: knowing the facts of a serious illness does not automatically prepare someone to acknowledge fear, explain prognosis clearly or invite a patient into decisions. Rehearsal with a responsive partner gives learners a chance to practise those choices.[1]

Thirty minutes, three communication skills

The system, SOPHIE, presents an animated patient with advanced cancer. Users converse by video-style interface, and the system gives feedback about three behaviours: empathising with distress, speaking explicitly about medical realities, and empowering the patient to participate in decisions. It combines structured dialogue rules with language-model responses, rather than letting an unrestricted chatbot invent the entire scenario. Its feedback points to specific choices in the trainee's conversation.[1]

Twenty-six participants were assigned to SOPHIE, and 25 to a control group. Both received the same underlying framework and approximately 30 minutes of material; the distinction was that one group could rehearse interactively and receive personalised feedback while the other group studied written examples. Before and after training, participants held conversations with trained actors playing patients. The encounters were recorded and assessed by the actors and four independent raters using a defined communication rubric. The four third-party raters were blinded to both group assignment and whether the encounter came before or after training.[1]

The results

Additional improvement with SOPHIE versus reading

Additional improvement with SOPHIE versus reading
Communication measureEstimated score difference
Overall communication0.09 (95% CI 0.04–0.14)
Empowering the patient0.11
Explicit communication0.08
Empathy0.07

Participants also rated their confidence more highly after SOPHIE: 4.31 versus 3.83 on a five-point scale. The confidence result complements the observed conversations, though it measures a different outcome. A learner can feel more capable without necessarily communicating better; this study collected both kinds of evidence.[1]

What made practice different from reading

Serious-illness conversations are partly a test of timing. A clinician can memorise 'ask about patient values' and still respond poorly when a person expresses fear. Repeated interaction gives the learner an opportunity to choose a sentence, hear a reaction, notice a missed opening and try again. SOPHIE's hybrid design was intended to allow more varied responses while keeping the medical scenario within an educational structure. The study supports the value of this full training experience, not an isolated claim that language generation by itself improved empathy.[1]

The trial tested the full package of interactive rehearsal and feedback against reading, so it cannot isolate the contribution of the language model or establish an advantage over equally intensive coaching with a human actor. The sample was small and the assessment immediate. Whether the skills persist or transfer to conversations with real patients remains open.[1]

Practice that can be repeated

The practical opportunity is to make rehearsal easier to schedule and repeat between supervised teaching sessions. A larger study could test repeated use and later patient-actor encounters before moving to real-care outcomes. For now, SOPHIE offers a concrete educational result: trainees changed how they communicated after a brief session, and observers could detect the difference.[1]

Follow the evidence

Sources & further reading