nXcomms Intelligent Patient Simulation

BioMojo, LLC, in collaboration with researchers at the University of North Carolina at Chapel Hill (UNC) and medical subject matter experts (SMEs), created nXcomms software. This software adds natural language processing (NLP) and artificial intelligence (AI) features to simulated patients – both medical manikins and screen-based virtual patient simulators. nXcomms uses cutting-edge technologies to provide enhanced interactive training experiences, including capabilities for learners to ask questions and receive responses from the simulated patients and for instructors to dynamically control the simulation, including changing the underlying physiology using voice control. AI functionality allow this software to learn from iterative training events.

nXcomms allows for the future incorporation of multiple input modalities, including speech, gesture, and sketch as natural ways for a user to communicate with intelligent systems, and support multiple modes of feedback, including graphics, video, and speech. Our system is designed to run optimally via a cloud connection. In future development efforts, we will make enhancements necessary to run the system offline.

Apart from the core NLP elements, we built our system to work well with virtually any manikin/simulator environment. nXcomms uses a Representational State Transfer (REST) application programming interface (API). REST style interfaces are an enabling feature for web services, which in turn make data access and control information from the rest of the network available to web applications and mobile apps. Adding a RESTful API to nXcomms provided a standard mechanism for any web service or tool to access and manipulate medical simulation.