Building a believable training conversation
I am contributing to a broader $5.2M Department of Defense-funded virtual patient grant project at Arizona State University. My work focuses on AI-driven virtual patients that present insomnia-related cases for therapist training and clinical education.
The goal is to create a conversational experience that behaves consistently like a patient within a defined scenario. The system must retrieve the right case context, preserve patient state across turns, and respond in a way that remains useful for a structured training session.
My role
I redesign and evaluate the conversational workflows that shape how the virtual patient interprets a therapist's question and produces a grounded response. The work combines RAG, semantic retrieval, prompt engineering, and agentic AI orchestration.
- Ground responses in relevant patient and scenario context.
- Improve semantic retrieval across varied therapist prompts.
- Coordinate agent responsibilities across the dialogue flow.
- Refine prompts for consistency, realism, and response quality.
- Evaluate failures and feed the findings back into the workflow.
Response accuracy
70.5% to ~99.3%
By rebuilding the conversational workflow and retrieval behavior, I improved response accuracy from 70.5% to approximately 99.3% under the project's current evaluation criteria. This is a project-specific research result, not a measure of clinical efficacy.
How the workflow comes together
- Interpret the therapist's input and current dialogue state.
- Retrieve semantically relevant patient and scenario context.
- Route the context through the appropriate agent workflow.
- Generate a response constrained by the virtual patient profile.
- Evaluate the response for grounding, consistency, and accuracy.
- Use evaluation findings to improve retrieval and prompting.
Why it matters
Virtual patients can provide repeatable, accessible practice scenarios for therapist training. A well-grounded system gives trainees room to explore different conversational approaches while keeping the simulated patient's history and behavior coherent throughout the session.
Work in progress
This research is actively evolving. The architecture, evaluation methods, and performance figures may change as the project moves through further testing and refinement.