Training setup for mixed reality surgeon training

From Functional Prototype to Product - Fast

What did Solcept Contribute to Mixed Reality Training for Orthopaedic Surgeons?

Customer's Challenge

One of the AO Foundation's innovations is a new training concept called DEHST (Digitally Enhanced, Hands-on Surgical Training). It is designed for the practice of a surgeon's basic psychomotor skills and is based on a mixed reality setup.

An important component of this setup is the software, which records the spatial position of real objects (such as surgical instruments, drills, artificial bone models and the model of an X-ray machine) and generates realistic X-ray images from them. This enables an extended training spectrum and a new type of user experience. In addition, personalized performance indicators are collected, which are transferred to the Cloud via smartphone and QR codes and can be used for comprehensive training analysis.

This software was developed at the AO Research Institute Davos as a MATLAB prototype, which was to be rewritten and expanded as a C++/C# native application as part of product development. 

Outcome

The AO Foundation now has a modular software solution that, in combination with the mechanical training setup, enables mobile, cost-effective, and realistic training that improves the quality of surgeon instruction.

Implementation

The Solcept specialists for image processing and Windows quickly created a first version of the software, which is continuously expanded with new training scenarios. 

Customer

The AO Foundation, a medically-led, non-profit organization based in Davos, is the world's leading organization for education, innovation and research in the surgical treatment of trauma and musculoskeletal disorders. 

Project Scope

Expertise

  • Windows application development
  • Ray-tracing calculations  to simulate X-ray images
  • 2- and 3-dimensional image processing and positioning

Technologies

  • Windows 10/11
  • C#
  • Modern Windows Application
  • WinUI3
  • Microsoft Store
  • .NET
  • QR Codes
  • C++
  • OpenCV for 2D image processing
  • ITK for 3D image processing
  • ToF (Time-of-Flight) sensors
  • IMU (Inertial Measurement Units)
  • High-resolution cameras
  • MATLAB

Are you looking for a fast implementation of your idea? Send me an email!

These References Could Be Interesting for You

RCID/ TouchGo: man opens door without key

Kaba: Key in the Pocket – Door Opens

Kaba: Key in the Pocket – Door Opens

How did we bring technology of capacitive transmission to market maturity for Kaba?

Test and measurement setup for an industrial sensor (prototype)

Excitation & Processing for Sensors

Excitation & Processing for Sensors

How did we optimize the electronics and software for sensors with DSP and prepared them for series production?

Life parameters display in operation room

Medical Signal Processing

Medical Signal Processing

How did we concentrate the signal processing on one processor, thereby optimizing size and price?

Female Worker Monitoring Industrial Controls

Sensor Systems: Support, Expertise and Innovation

Sensor Systems: Support, Expertise and Innovation

How have we supported our sensor customer over the years? In software, electronics and project management?

Projects? Ideas? Questions? Let's do a free initial workshop!