Training setup for mixed reality surgeon training

From Functional Prototype to Product - Fast

What did Solcept Contribute to Mixed Reality Training for Orthopaedic Surgeons?

Customer's Challenge

One of the AO Foundation's innovations is a new training concept called DEHST (Digitally Enhanced, Hands-on Surgical Training). It is designed for the practice of a surgeon's basic psychomotor skills and is based on a mixed reality setup.

An important component of this setup is the software, which records the spatial position of real objects (such as surgical instruments, drills, artificial bone models and the model of an X-ray machine) and generates realistic X-ray images from them. This enables an extended training spectrum and a new type of user experience. In addition, personalized performance indicators are collected, which are transferred to the Cloud via smartphone and QR codes and can be used for comprehensive training analysis.

This software was developed at the AO Research Institute Davos as a MATLAB prototype, which was to be rewritten and expanded as a C++/C# native application as part of product development. 

Outcome

The AO Foundation now has a modular software solution that, in combination with the mechanical training setup, enables mobile, cost-effective, and realistic training that improves the quality of surgeon instruction.

Implementation

The Solcept specialists for image processing and Windows quickly created a first version of the software, which is continuously expanded with new training scenarios. 

Customer

The AO Foundation, a medically-led, non-profit organization based in Davos, is the world's leading organization for education, innovation and research in the surgical treatment of trauma and musculoskeletal disorders. 

Project Scope

Expertise

  • Windows application development
  • Ray-tracing calculations  to simulate X-ray images
  • 2- and 3-dimensional image processing and positioning

Technologies

  • Windows 10/11
  • C#
  • Modern Windows Application
  • WinUI3
  • Microsoft Store
  • .NET
  • QR Codes
  • C++
  • OpenCV for 2D image processing
  • ITK for 3D image processing
  • ToF (Time-of-Flight) sensors
  • IMU (Inertial Measurement Units)
  • High-resolution cameras
  • MATLAB

Are you looking for a fast implementation of your idea? Send me an email!

These References Could Be Interesting for You

Life parameters display in operation room

Medical Signal Processing

Medical Signal Processing

How did we concentrate the signal processing on one processor, thereby optimizing size and price?

Women takes a picture of something on a table using a smartphone

Mobile Image Processing

Mobile Image Processing

How does an idea become an image processing app, fast and with little risk?

Train

Ralpin: IoT for Piggyback Transport

Ralpin: IoT for Piggyback Transport

How did we adapt the backend of a telematics solution from road to rail for Ralpin?

Automated cutting table with two arms

Zünd: Safety Small, Light, Inexpensive

Zünd: Safety Small, Light, Inexpensive

How did we support Zünd Systemtechnik in the development of a new safety solution?

Projects? Ideas? Questions? Let's do a free initial workshop!