Google Research and Google DeepMind have advanced their research medical AI system, AMIE, to demonstrate real-time clinical video consultation capabilities in a first-of-its-kind study. Built on Gemini and Project Astra using a multi-agent architecture, the system interprets visual and auditory cues, guides virtual physical exams, and reasons diagnostically in real time.
In a randomized study involving simulated consultations with patient actors and primary care physicians, AMIE was assessed favorably across core clinical competencies including history-taking thoroughness, diagnostic accuracy, management appropriateness, and communication quality. Additionally, patient actors preferred the video experience over text chat.
While AMIE remains a research system requiring further study before responsible real-world deployment, this demonstration highlights potential advancements in health AI.