Intelligent Support for Skilled Workers Using Extended Reality

Extended Reality (xR) — including the Mixed Reality (MR) continuum from Virtual Reality (VR) to Augmented Reality (AR) — opens up powerful learning and working environments while providing intelligent, context-aware support.

To fully leverage this potential, we develop intelligent solutions that enable efficient creation and use of Mixed Reality applications — supporting people in training, manufacture, maintenance, and repair.

Intelligent assistance means our systems recognize situations and provide context-specific guidance — whether in VR or AR — across the full Mixed Reality spectrum.

Our solutions adapt flexibly to specific task requirements, data flows, and constraints in data preparation.

Our solutions combine advanced technologies to enable adaptive and context-sensitive support systems that assist users across a wide range of work environments.

Visual Recognition and Analysis

• Real-time computer vision for interpreting physical scenes
• Object detection using machine learning — e.g., based on CAD data
• Markerless pose estimation for accurate alignment of digital content

3D Capture and Semantic Representation

• Neural methods for fast, approximate 3D capture in XR environments

Comparison and Interaction

• As-is vs. to-be comparison of components, including deformable objects
• AR-supported sorting processes
• Step-by-step assembly guidance
• 3D instructions for maintenance and repair

The Mixed Reality continuum spans immersive VR to AR on a wide range of hardware — from head-mounted displays to tablets and smartphones.

Fraunhofer IGD has researched and developed VR/AR technologies since the mid 1990s. Despite great progress in performance, usability, and cost, several practical challenges remain:

• Automated data integration: 3D models from engineering must be processed without manual post-editing.
• Efficient scenario creation: MR applications must be easily created and adapted for training and assembly.
• Stable object recognition & tracking: Company-specific ML training data often requires significant effort.
• Fast and robust environment capture and semantic analysis for adaptive assistance.
• Robust comparisons between physical and digital components, even when parts move or deform.
• Building industrial metaverse platforms for sustainable, networked applications across the product lifecycle.

Are you looking to use Extended Reality (xR), Mixed Reality (MR), Virtual Reality (VR), or Augmented Reality (AR) to support your workforce?

Contact us — we bring deep experience, practical solutions, and technological excellence.

Our technologies are used across multiple industries and are supported in part by our spin-off companies.