Surgical Agent Orchestration Platform for Voice-directed Patient Data Interaction
PositiveArtificial Intelligence
A new voice-directed Surgical Agent Orchestration Platform (SAOP) has been developed to enhance da Vinci robotic surgery by allowing surgeons to interact with patient data hands-free. Built on a hierarchical multi-agent framework and utilizing Large Language Models (LLMs), the SAOP can autonomously execute tasks such as retrieving clinical information and manipulating 3D anatomical models through voice commands. The platform has been tested with 240 commands, achieving high accuracy and success rates. Additionally, it includes a Multi-level Orchestration Evaluation Metric (MOEM) to assess performance comprehensively. This innovation shows promise in improving the efficiency and effectiveness of minimally invasive surgeries, particularly in overcoming challenges related to speech recognition errors and ambiguous commands.
— via World Pulse Now AI Editorial System
