Project Interview

About the Project

During the fellowship, I wanted to explore the possibilities to establish links between the actions of recipients and an existing narrative that is responsive to the choices and behaviours of the recipients. To do this, I developed a performative application built specifically for AR experiences.

I experimented with how AR can be used in these spaces and how it can be can be complemented with physical elements. I combined AR with video mapping and physical computing components; this can create a reactive space that changes through interaction. In order to add a sensual layer to this, I worked with different different sensory impressions and experimented with audio impressions. I also worked with surfaces that can be played on and changed by mapped videos: an elevation in the surface can thus be a table, the roof of a car, or the surface of a swimming pool, depending on the video overlay. Both large, wide spaces and very narrow, small spaces can be simulated.

The AR, the physical computing components and the video mapping are very closely intertwined. In this way they can influence one another and a physical interaction with the memories becomes possible. During the fellowship, I worked on building the interactive physical elements and programming the network setup. I also tried to find out which video aesthetics are particularly suitable for mapping different interaction modes of the AR application and to build a technically well-functioning network.

My goal was to build a performative event that responds to the activity level and curiosity of the visitors, combining fantastic and realistic elements. Depending on the level of interaction, visitors should be able to experience different narratives of the same story.

Research Questions:

• How can a workable and inclusive network be installed?
• Which intersections of digital and physical interactions are interesting?
• How can an interactive installation be interesting for those who are a little more on the passive side?