Research overview

Keywords

Operation of the proposed solution

The main goal is to introduce AI techniques in the interaction design to:

• i Enable mechanisms for multi-modal natural interaction (gestural, vocal, bio-feedback, etc.) in augmented, virtual and mixed reality environments.
• ii Allow the learning of user interaction patterns and therefore the design of highly personalized interaction solutions based on user preferences or any cognitive and/or motor disabilities.
• iii Human-AI collaboration, with “human-in-the-loop” approaches in the AI learning phase.

Potential applications: precision human-machine interaction (identifying the optimal tailoring of the interface to specific users based on their personal preferences, emotional state, current situation, tasks to be performed); Virtual/Augmented reality with AI-powered sensing & actuation, to improve the user’s perception within the virtual environment by optimizing visual and sound feedback (e.g., bio-feedback, to encourage the user to implement control strategies).

Open challenges

• 1 AI on wearable devices (on-device ML)
• 2 Human-in-the-loop approaches for AI
• 3 Precision Human-Computer Interaction

Selected bibliography