Training setup for mixed reality surgeon training

From Functional Prototype to Product - Fast

What did Solcept Contribute to Mixed Reality Training for Orthopaedic Surgeons?

Customer's Challenge

One of the AO Foundation's innovations is a new training concept called DEHST (Digitally Enhanced, Hands-on Surgical Training). It is designed for the practice of a surgeon's basic psychomotor skills and is based on a mixed reality setup.

An important component of this setup is the software, which records the spatial position of real objects (such as surgical instruments, drills, artificial bone models and the model of an X-ray machine) and generates realistic X-ray images from them. This enables an extended training spectrum and a new type of user experience. In addition, personalized performance indicators are collected, which are transferred to the Cloud via smartphone and QR codes and can be used for comprehensive training analysis.

This software was developed at the AO Research Institute Davos as a MATLAB prototype, which was to be rewritten and expanded as a C++/C# native application as part of product development. 

Outcome

The AO Foundation now has a modular software solution that, in combination with the mechanical training setup, enables mobile, cost-effective, and realistic training that improves the quality of surgeon instruction.

Implementation

The Solcept specialists for image processing and Windows quickly created a first version of the software, which is continuously expanded with new training scenarios. 

Customer

The AO Foundation, a medically-led, non-profit organization based in Davos, is the world's leading organization for education, innovation and research in the surgical treatment of trauma and musculoskeletal disorders. 

Project Scope

Expertise

  • Windows application development
  • Ray-tracing calculations  to simulate X-ray images
  • 2- and 3-dimensional image processing and positioning

Technologies

  • Windows 10/11
  • C#
  • Modern Windows Application
  • WinUI3
  • Microsoft Store
  • .NET
  • QR Codes
  • C++
  • OpenCV for 2D image processing
  • ITK for 3D image processing
  • ToF (Time-of-Flight) sensors
  • IMU (Inertial Measurement Units)
  • High-resolution cameras
  • MATLAB

Are you looking for a fast implementation of your idea? Send me an email!

These References Could Be Interesting for You

Oyster with pearl

Deeply Embedded Security

Deeply Embedded Security

How was cyber-security attained for a deeply embedded Cortex-M system?

[Translate to English:] Flugtestinstrumentierung: orFlight test instrumentation: orange electronics box with measurement and recording devices for flight testsange Elektronikbox mit Mess- und Aufzeichnungsgeräten für Flugtests

Marenco: Flight Test Instrumentation

Marenco: Flight Test Instrumentation

What was the solution for the data acquisition and telemeter for the Skye SH09 of Marenco Swisshelicopter?

Southern Rockhopper Penguin, Eudyptes chrysocome

Embedded Linux: Turn-Key Solutions

Embedded Linux: Turn-Key Solutions

What are the soft- and hardware solutions we can offer you for embedded Linux systems?

Red-grey paraglider starts

Flytec: Smart Vario Interfaces

Flytec: Smart Vario Interfaces

How did we contribute to the wireless capabilities of a modern instrument for Flytec/ Volirium?

Projects? Ideas? Questions? Let's do a free initial workshop!