Training setup for mixed reality surgeon training

From Functional Prototype to Product - Fast

What did Solcept Contribute to Mixed Reality Training for Orthopaedic Surgeons?

Customer's Challenge

One of the AO Foundation's innovations is a new training concept called DEHST (Digitally Enhanced, Hands-on Surgical Training). It is designed for the practice of a surgeon's basic psychomotor skills and is based on a mixed reality setup.

An important component of this setup is the software, which records the spatial position of real objects (such as surgical instruments, drills, artificial bone models and the model of an X-ray machine) and generates realistic X-ray images from them. This enables an extended training spectrum and a new type of user experience. In addition, personalized performance indicators are collected, which are transferred to the Cloud via smartphone and QR codes and can be used for comprehensive training analysis.

This software was developed at the AO Research Institute Davos as a MATLAB prototype, which was to be rewritten and expanded as a C++/C# native application as part of product development. 

Outcome

The AO Foundation now has a modular software solution that, in combination with the mechanical training setup, enables mobile, cost-effective, and realistic training that improves the quality of surgeon instruction.

Implementation

The Solcept specialists for image processing and Windows quickly created a first version of the software, which is continuously expanded with new training scenarios. 

Customer

The AO Foundation, a medically-led, non-profit organization based in Davos, is the world's leading organization for education, innovation and research in the surgical treatment of trauma and musculoskeletal disorders. 

Project Scope

Expertise

  • Windows application development
  • Ray-tracing calculations  to simulate X-ray images
  • 2- and 3-dimensional image processing and positioning

Technologies

  • Windows 10/11
  • C#
  • Modern Windows Application
  • WinUI3
  • Microsoft Store
  • .NET
  • QR Codes
  • C++
  • OpenCV for 2D image processing
  • ITK for 3D image processing
  • ToF (Time-of-Flight) sensors
  • IMU (Inertial Measurement Units)
  • High-resolution cameras
  • MATLAB

Are you looking for a fast implementation of your idea? Send me an email!

These References Could Be Interesting for You

Helicopter on snowy peak

Marenco: Aviation Tank Sensor

Marenco: Aviation Tank Sensor

How did we develop an exact tank gauge according to aviation standards for the new helicopter of Marenco Swisshelicopter?

Women takes a picture of something on a table using a smartphone

Mobile Image Processing

Mobile Image Processing

How does an idea become an image processing app, fast and with little risk?

Test and measurement setup for an industrial sensor (prototype)

Excitation & Processing for Sensors

Excitation & Processing for Sensors

How did we optimize the electronics and software for sensors with DSP and prepared them for series production?

A200 professional coffee machine

Franke: Simple Coffee Brewing

Franke: Simple Coffee Brewing

How did Franke arrive at a complex control system at low unit costs for their professional coffee machine?

Projects? Ideas? Questions? Let's do a free initial workshop!