Training setup for mixed reality surgeon training

From Functional Prototype to Product - Fast

What did Solcept Contribute to Mixed Reality Training for Orthopaedic Surgeons?

Customer's Challenge

One of the AO Foundation's innovations is a new training concept called DEHST (Digitally Enhanced, Hands-on Surgical Training). It is designed for the practice of a surgeon's basic psychomotor skills and is based on a mixed reality setup.

An important component of this setup is the software, which records the spatial position of real objects (such as surgical instruments, drills, artificial bone models and the model of an X-ray machine) and generates realistic X-ray images from them. This enables an extended training spectrum and a new type of user experience. In addition, personalized performance indicators are collected, which are transferred to the Cloud via smartphone and QR codes and can be used for comprehensive training analysis.

This software was developed at the AO Research Institute Davos as a MATLAB prototype, which was to be rewritten and expanded as a C++/C# native application as part of product development. 

Outcome

The AO Foundation now has a modular software solution that, in combination with the mechanical training setup, enables mobile, cost-effective, and realistic training that improves the quality of surgeon instruction.

Implementation

The Solcept specialists for image processing and Windows quickly created a first version of the software, which is continuously expanded with new training scenarios. 

Customer

The AO Foundation, a medically-led, non-profit organization based in Davos, is the world's leading organization for education, innovation and research in the surgical treatment of trauma and musculoskeletal disorders. 

Project Scope

Expertise

  • Windows application development
  • Ray-tracing calculations  to simulate X-ray images
  • 2- and 3-dimensional image processing and positioning

Technologies

  • Windows 10/11
  • C#
  • Modern Windows Application
  • WinUI3
  • Microsoft Store
  • .NET
  • QR Codes
  • C++
  • OpenCV for 2D image processing
  • ITK for 3D image processing
  • ToF (Time-of-Flight) sensors
  • IMU (Inertial Measurement Units)
  • High-resolution cameras
  • MATLAB

Are you looking for a fast implementation of your idea? Send me an email!

These References Could Be Interesting for You

Knotted ropes

Consulting for Functional Safety

Consulting for Functional Safety

Functional Safety / Machinery Directive – Which solution is the most efficient? What exactly do we have to do?

Test and measurement setup for an industrial sensor (prototype)

Excitation & Processing for Sensors

Excitation & Processing for Sensors

How did we optimize the electronics and software for sensors with DSP and prepared them for series production?

Night sky with star tracks

Architecture for Satellite Communication System

Architecture for Satellite Communication System

How did we collaborate on the system and software architecture for a space system?

DSP board with with densely arranged components

DSP Board with High Function Density

DSP Board with High Function Density

How did a manufacturer get a customized camera board fast and easily?

Projects? Ideas? Questions? Let's do a free initial workshop!