interaktionsKRAFT

  Copyright: © Apostolos Vrontos

  

 

Perception of Forces and Force Effects in Interactive MR Spaces for Immersive and Effective Learning of Movements

 

Synopsis

In the joint project interaktionsKRAFT, an innovative haptic component is to be developed for the simulation of forces and force effects for use in a mixed reality, in short MR, environment, which is to find its application in the field of physiotherapy. The so-called electromyostimulation is uses electrodes attached to the body to activate the muscles through electrical stimuli. The goal of the researchers at interaktionsKRAFT is to link the various perceptual components in the interaction – for the best possible immersion through the simultaneous visual, acoustic and haptic experience. The new interaction techniques and strategies will be tested and further developed in various application scenarios as part of the research work.

Challenges

The opportunities for interaction and intervention for movement learning are currently severely limited when physiotherapeutic exercises are performed independently in the home environment without concurrent instruction and correction from a physiotherapist. There is a lack of interaction techniques beyond visual and auditory components for skill acquisition at a distance. In particular, the required feedback of external forces acting on the body (e.g., in the form of corrections of movement or posture by instructors), and the resulting perception of different weights and adaptation processes of the human body (e.g., balance stabilization and fatigue), cannot currently be represented in interactive MR systems. The approach for the MR haptics component to be developed in the interaktionsKRAFT project involves the use of electromyostimulation, in short EMS, of muscles. EMS activates and stresses the muscles by stimulation current from the outside and generates a kinesthetic perception, which allows for the simulation of perceptions of forces and force application.

Goals

The solution is a new haptic component that simulates force effects in MR. So-called electromyostimulation is used: electrodes attached to the body activate the muscles through electrical stimuli. The goal of the researchers at interaktionsKRAFT is to link the various perceptual components in the interaction – for the best possible immersion through the simultaneous visual, acoustic and haptic experience. The new interaction techniques and strategies will be tested and further developed in various application scenarios as part of the research work. Motion learning represents a significant application area for such a component. Possible applications include early childhood, school, competitive and mass sports, learning of working movements, learning of movements for musical instruments, active movement therapy as an aspect of physiotherapy and movement training courses, but also the execution of natural movements in MR film production and further applications in the field of interactive MR games or leisure activities.

Methodology

The interactive MR system as a whole, consisting of visual-acoustic components and haptic components to be developed, will be iteratively tested and further developed with regard to its effect in the application area of movement learning. Thereby, significant improvements can be achieved especially for the immersion of users, the interaction and the quality of knowledge transfer. The result is an interactive and location-independent MR knowledge space for immersive and effective movement learning, which makes a contribution to the digital society.

Funding

BMBF funding on interactive technologies for health and quality of life as part of the funding priority “Interactive Systems in Virtual and Real Spaces – Innovative Technologies for the Digital Society”.

Project Partners

AIXTRA

LAVAlabs

MedAix

Velamed GmbH