Milestone Achievements for the XTREME Prototype Shared in Helsinki

During the recent XTREME consortium meeting in Helsinki, project partners had the opportunity to present and demonstrate key technical milestones reached in the development of the XTREME prototype.

The session featured exciting progress across multiple areas, including:

  • 3D SLAM-based reconstruction of the concert venue and studio theatre
  • Human–virtual human interaction mechanisms
  • Real-time audience motion and gesture capture
  • Egocentric interaction tracking, offering insight into individual engagement
  • Virtual sound source localisation, aligning spatial audio with dynamic environments

These developments represent a major step toward the project’s ambition to create immersive, mixed reality art experiences that respond to and include both performers and audiences.

A huge thank you to all partners involved for pushing the boundaries of what’s possible at the intersection of XR  and live performance.

More updates to come as we move closer to our upcoming test productions! See the gallery from the different project partners’ updates.

Related articles

XTREME Consortium meeting – June 2026

The XTREME consortium gathered online on 29–30 June 2026 for its latest project meeting, reviewing use case outcomes, screening the XTREME documentary, and mapping the final steps toward project completion.

ÅTERFÖDELSEN // REBIRTH – XTREME’s MUNCH use case comes to life in Oslo

On 15–16 May 2026, the XTREME project reached a major milestone with the premiere of ÅTERFÖDELSEN // REBIRTH at MUNCH in Oslo — a room-scale XR installation by Silvana Imam and Paula Strunden, two years in the making.

XTREME dissemination event: Spatial Thinking & Interfacing with 4DSOUND at De Singel, Antwerp, Belgium

In May 2026, XTREME project partner 4DSOUND hosted a Masterclass and Demo Room as part of the XTREME residency on immersive spatial sound for mixed reality. The event showcased the 4DS XR Framework and invited artists, professionals, and the public to explore interactive spatial audio experiences firsthand.