The University of Twente (UT) was established in 1961 and is a public technical university located in Enschede, Netherlands. At the University of Twente, we are pioneers in fusing technology, science and engineering with social sciences to impact the world around us. The driving force for the students, scientists and educators is a deep sense of connection with people who share a curious, entrepreneurial spirit.

In XTREME, UT is responsible for the assessment of potential XR sets, audio and visual equipment, scene understanding and 3D Audio–Visual reconstruction of the scene.

Principal Investigator: Assist. Prof. Ville Lehtola

Marionette AI-driven motion capture software gives creators the possibility of recording motion capture anywhere without the need for motion capture suits. After 3D animation is extracted from video, artist tools are available for making motion capture data ready to use in animation pipelines. The company is based in Copenhagen, Denmark.

In XTREME, Marionette will support motion capture with the AI-driven camera-based motion capture software.

Principal Investigator: Jennifer Anne Ipsen

The Italian Institute of Technology (IIT) is a scientific research centre based in Genoa, Italy. Its main goal is the advancement of science, in Italy and worldwide, promoting projects and discoveries oriented to human-centric applications and technology.

In XTREME, IIT is responsible for 3D audio–visual reconstruction of the scene: mapping multichannel sound to an acoustic image stream, multimodal audio-visual detection and Integration of 2D audio-visual reconstructed scene with 3D stream.

Principal Investigator: Dr. Pietro Morerio

MUNCH Museum is an art museum dedicated to the life and works of the Norwegian artist Edvard Munch. The museum was opened in 1963 and in 2021 it was moved to the new building at Bjørvika, Oslo. The museum building has been specifically created for unique art experiences and is a highly prestigious project for the City of Oslo. It is an impressive 13 floors modern building contracting: 11 galleries, over 200 works of Munch on permanent display, 4 500 square metres of gallery space and concert halls, cinema, and venue hire.

In XTREME, MUNCH is a space for XTREME audio-visual performance use case developed in a collaboration with an externally commissioned artist.

Principal Investigator: Birgitte Aga

Leibniz University Hannover (LUH), also known as the University of Hannover, is a public research university located in Hanover, Germany. It was founded in 1831. The spirit of Leibniz – as one of the nine leading universities of technology in Germany, Leibniz University Hannover is aware of its responsibility to contribute to identifying sustainable, peaceful, and responsible solutions to the key issues of tomorrow. The LUH’s expertise ranges from engineering and natural sciences to architecture and environmental planning, from law and economics to social sciences and humanities.

In XTREME, LUH is leading the work on developing the core technology, being also responsible for the human reconstruction and virtual presence: 3D Reconstruction of dynamically moving people, real-time motion capture of a person in a mobile environment, fine grain human pose estimation and audience motions and scene embedding.

Principal Investigator: Prof. Bodo Rosenhahn

Khora is a leading Scandinavian Virtual Reality (VR) and Augmented Reality (AR) production studio, creating cutting edge content within multiple application areas.

Khora is exploring the value potential of VR and AR through meaningful collaborations and partnerships, working within multiple industries, with a deep understanding of the technologies and of how and why businesses and institutions should be working within these emerging mediums.

In XTREME, Khora is engaged in the user experience design and scenarios of the XTREME use cases, being also responsible for content design, production and adaptation for some of the productions.

Principal Investigator: Matias Katajavaara Seidler

4DSOUND is an Amsterdam-based studio focusing on spatial sound as a creative medium. Since 2007, 4DSOUND has been at the forefront of some of the world’s most creatively challenging and technically complex projects using spatial audio in the context of music, architecture, interactive installations, fashion, performing arts and research.

In XTREME, 4DS is responsible for the integration of a high performance and high definition spatial audio engine, combined with an intuitive interface for creation and cross media interactivity. A 4DS system will also be a part of the Audio-Visual Performance developed in MUNCH.

Principal Investigator: Poul Holleman

Aalto University is a public research university located in Espoo, Finland. It was established in 2010 as a merger of three major Finnish universities: the Helsinki University of Technology, the Helsinki School of Economics and the University of Art and Design Helsinki. The close collaboration between the scientific, business and arts communities is intended to foster multi-disciplinary education and research.

In XTREME, AALTO is responsible for leading research on measuring audience experience in physical reality and in social XR.

Principal Investigator: Prof. Mikko Sams

Bolt Virtual is a market leader in the emerging technologies of eXtended reality, based in Athens, Greece. Since 2017 Bolt has been developing its own Virtual Reality, Augmented Reality and Mixed Reality applications for gaming, corporate marketing, promotion of cultural heritage, advertising tourism products, marketing tourism destinations, as well as for educational purposes.

In XTREME, BV is responsible for the definition of overall system architecture and development of application programming interface, content design, production, and adaptation of the audio-visual performance, as well as for the XTREME exploitation activities.

Principal Investigator: Yannis Parcharidis

Immersive Stories is an award-winning production company with a focus on engaging storytelling and innovative creative concepts across multiple media platforms. Immersive Stories was founded in 2017 by producer and director, Ane Skak, building on her experience with editorial management, production and strategy planning in film, television, radio, podcast, digital content, and VR. Ane Skak has produced more than 50 VR experiences in close cooperation with institutions in Denmark and abroad.

In XTREME, Immersive Stories is engaged in the development of the creative concepts and experiences design for the virtual opera experience and the Irish traditional music concert.

Principal Investigator: Ane Skak