The CORPUS project, which I initiated, puts artists at the center of AI development. Musical works are deliberately contributed to train AI systems — legally, with fair compensation, and under ethical conditions. It’s not about fear of technology, but about new artistic possibilities — and more controllable AI. CORPUS aims to show how AI can become a partner, not a threat.
An augmented reality orchestra plays the famous "Mission: Impossible" theme by Lalo Schifrin. With your smartphone as a magic magnifying glass, you can get very close to the instruments. Experience the orchestra as a whole or listen to the individual instruments, just as you like. My "Mission: Impossible OrchestrAR" app allows you to experience music in a new way.
Experience the famous orchestral suite "The Planets" by Gustav Holst, played by the Munich Philharmonic Orchestra, as an interactive audio walk in a park near you, increasingly all over the world. All you need is a smartphone and headphones. In addition to being the artistic and technical director and 3D sound engineer, I produced this project.
A flashy bird of paradise in an industrial loft or a rock fan with a Boho apartment? In the app "Unite in Taste" you can create your own digital self. Your appearance, clothing, apartment or favorite tunes – create your own avatar and design a home that suits your own personal tastes. Together with Michael Hartung and Jörg Hüttner I created sound design and music for this fun game and implemented them with FMOD.
Labyrinth deLux - A Crusoe Quest is a VR puzzle game in first person perspective, set in an alien space station. I created a musical sound design for the various game elements, which interact together to create a 3D soundscape through which you move (6 DoF).
Lure is an artistic research project I lead that explores machine learning in theater and music. We have explored a variety of machine learning techniques in combination with musical instruments, voice and narration. The artistic research transfers questions on the topics of human–machine interaction and artificial intelligence to the fields of theatre and music.
I created sound and music for the "experimenta explorer", a VR/AR app for Germany’s largest science center in Heilbronn, the experimenta. The app works twofold – as a virtual stroll through the newly constructed building and as a stand-alone game. In the game mode, players get to find out more about select exhibits while assembling a robot from parts they find/win. With their robot they can play through several levels – all in augmented reality.
With the free app "INSIDE MPHIL - Frühling" (spring) you can experience the Munich Philharmonic Orchestra virtually on a meadow of your choice as if the musicians were set up there. With the GPS-connected smartphone and headphones you enter the orchestra acoustically and hear the instruments as if you were standing next to them, just as the musicians hear themselves and their colleagues. This is made possible by the sophisticated smartphone app.
ANON: Escape the Murder is a first person adventure game series based on the world of ANON the film created by critically acclaimed and award winning director Andrew Niccol (known for Gattaca, In Time). The mobile action adventure combines the thrilling story-world of the film with cutting-edge mobile technology to create a highly immersive gaming experience.
The standard theatre situation was reconfigured to an installation- and rave-like situation by means of the MAYA augmented reality App. Alive and present as an actor was only the mezzo-soprano Martina Koppelstetter. The digital world from which she originated was only visible through smartphones and AR. Experiencing this world through own smartphones, the audience strolled through the ruins and became the counterpart for MAYA with its presence, augmenting MAYA’s loneliness: MAYA had to sing against a mass of audience members gaping through their smartphones.