NVIDIA Open Sources First GPU-Accelerated Medical Physics Simulation Framework

<div id="bsf_rt_marker"></div><p><span style="font-weight: 400;">Before a healthcare robot can be useful in the real world, it has to learn how the physical world pushes back. Anatomy varies. Instruments bend, press, slip and interact with tissue. Imaging can be noisy or incomplete. And the rare, edge scenarios developers most need to understand don’t appear on schedule.</span></p> <p><span style="font-weight: 400;">That creates one of the biggest bottlenecks in healthcare robotics: obtaining the enormous amount of varied data developers need to train, test and improve robot behavior.  </span></p> <p><span style="font-weight: 400;">NVIDIA Medical Physics Simulation framework — a new open source, GPU-accelerated capability within NVIDIA Isaac for Healthcare — announced today, helps medical robotics developers model anatomy-device interaction, generate hard-to-capture scenarios, test in silico, and train or evaluate robot policies before hardware-heavy testing. </span></p> <p><span style="font-weight: 400;">The framework brings together anatomy and medical device behavior with sensor simulation and robot learning so teams can create reusable simulation environments instead of rebuilding custom scenes for every workflow, saving developers time and bringing innovations to market faster. </span></p> <p><span style="font-weight: 400;">Because Medical Physics Simulation is open source, healthcare robotics developers can inspect the framework, adapt it to their own devices and workflows, and build on a GPU-accelerated foundation that works seamlessly with the broader NVIDIA stack.</span></p> <p><span style="font-weight: 400;">Open source is especially important in healthcare because teams need transparency into the data, models and weights that shape system behavior. Access to open models and model weights can help developers reproduce results, evaluate performance across different anatomies and scenarios, identify limitations and build evidence for regulatory review. </span></p> <h2><strong>A Virtual Training Ground for Medical Robots</strong></h2> <p><span style="font-weight: 400;">For </span><a target="_blank" href="https://www.nvidia.com/en-us/glossary/generative-physical-ai/"><span style="font-weight: 400;">physical AI</span></a><span style="font-weight: 400;">, experience is data in motion. Developers need to train robots to operate properly even when anatomy changes, devices behave differently, conditions shift or a policy fails unexpectedly.</span></p> <p><span style="font-weight: 400;">Medical Physics Simulation helps developers simulate anatomy, device contact, friction and sensor inputs, then test in interactions and environments to evaluate how robots perform across those changes. Powered by NVIDIA CUDA and part of Isaac for Healthcare — built on the NVIDIA Warp, Newton and Cosmos simulation and generative AI technologies — the framework can run hundreds of parallel simulation environments, helping teams explore more scenarios and identify failure modes earlier in development. </span></p> <p><span style="font-weight: 400;">For robot builders, this turns simulation from a bespoke engineering project into reusable infrastructure. The difference now is scale: </span><a target="_blank" href="https://arxiv.org/abs/2503.18616"><span style="font-weight: 400;">benchmarks</span></a><span style="font-weight: 400;"> show 8,192 robot-training environments running in parallel with GPU-native simulation cut training from over five hours to under two minutes. </span></p> <p><span style="font-weight: 400;">With this framework, developers can connect vascular anatomy, flexible instruments such as catheters and guidewires, simulated X-ray imaging and reinforcement learning. The framework is designed to extend beyond that example to additional devices, anatomies, sensors and healthcare robotics domains.</span><span style="font-weight: 400;"><br /> </span></p> <p><span style="font-weight: 400;">Medical Physics Simulation brings together classical physics simulation and generative AI physics simulation. Classical simulation helps model known physical rules, such as device contact, friction and motion. <a target="_blank" href="https://github.com/isaac-for-healthcare/Cosmos-H-Dreams">NVIDIA Cosmos-H Dreams</a>, the real-time generative AI physics simulation capability within Medical Physics Simulation, helps model visual scene dynamics learned from procedural data.</span></p> <p><span style="font-weight: 400;">Together, these approaches give developers a richer way to build and test healthcare robotics systems in virtual environments before moving to physical prototypes and lab testing.</span></p> <h2><strong>An Ecosystem Building the Future of Medical Robotics</strong></h2> <p><span style="font-weight: 400;">Medical robotics leaders are already </span><span style="font-weight: 400;">applying simulation-driven development to solve specific surgical challenges</span><span style="font-weight: 400;">.</span></p> <p>CMR Surgical <span style="font-weight: 400;">and </span>Cambridge Consultants, part of Capgemini,<span style="font-weight: 400;"> are using </span><span style="font-weight: 400;">Cosmos-H-Dreams</span> <span style="font-weight: 400;">to implicitly learn interaction physics for soft-tissue surgical procedures and generate patient-specific simulations. CMR contributed nearly 500 hours of anonymized clinical data from its Versius Surgical Robotic System to the Open-H Embodiment open dataset, benefiting procedures including cholecystectomy, prostatectomy, hernia repair and hysterectomy.</span></p> <p><span style="font-weight: 400;">“Open source models allow us to build on shared knowledge, accelerating responsible innovation and, ultimately, gives us the potential to deliver more consistent care and better outcomes for patients worldwide,” said Chris Fryer, chief technology officer at CMR Surgical.</span></p> <p>Johnson &amp; Johnson MedTech<span style="font-weight: 400;"> i</span><span style="font-weight: 400;">s using Isaac for Healthcare’s Medical Physics Simulation and a Cosmos-based foundation model </span><span style="font-weight: 400;">to build digital twins of its endoluminal MONARCH platform for urology, modeling complex anatomy and kidney-stone scenarios.</span><span style="font-weight: 400;"><br /> </span><span style="font-weight: 400;"><br /> </span>XCath<span style="font-weight: 400;"> is using the Medical Physics Simulation for endovascular autonomy policy training. </span>Inner Logic <span style="font-weight: 400;">i</span><span style="font-weight: 400;">s accelerating the evolution of medical technology with synthetic data, validating device mechanics and producing in silico evidence to support regulatory pathways with NVIDIA Medical Physical Simulation.</span></p> <p>Medtronic Structural Heart<span style="font-weight: 400;"> is exploring applying Medical Physics Simulation with simulated X-ray sensing to generate data for catheter navigation research.</span></p> <h2><strong>A New Layer in the Isaac for Healthcare Stack</strong></h2> <p><span style="font-weight: 400;">As a modular capability within NVIDIA Isaac for Healthcare, Medical Physics Simulation can be used on its own or alongside digital twin pipelines, medical sensor simulation, the NVIDIA Isaac Lab open robot-learning framework and NVIDIA open models and policies.</span></p> <p><i><span style="font-weight: 400;">Developers can explore the open source </span></i><a target="_blank" href="https://isaac-for-healthcare.github.io/medical-physics-simulation/"><i><span style="font-weight: 400;">Medical Physics Simulation framework</span></i></a><i><span style="font-weight: 400;">, review available reference workflows and start building simulation environments for their own devices, anatomies and healthcare robotics applications.</span></i></p>