RESEARCH PLATFORM

Academy for Theatre and Digitality

Digitalizing Narrative Spaces

completedFellowship

Summary
'Digitalizing Narrative Spaces' is a project by Fabian Raith which uses AR, video mapping and physical computing to creative a performative event that responds to the activities and curiosities of its visitors, and combines fantasy and reality. Depending on their interactions, visitors experience different narratives of the same story.

Project Interview

About the Project

During the fellowship, I wanted to explore the possibilities to establish links between the actions of recipients and an existing narrative that is responsive to the choices and behaviours of the recipients. To do this, I developed a performative application built specifically for AR experiences.

I experimented with how AR can be used in these spaces and how it can be can be complemented with physical elements. I combined AR with video mapping and physical computing components; this can create a reactive space that changes through interaction. In order to add a sensual layer to this, I worked with different different sensory impressions and experimented with audio impressions. I also worked with surfaces that can be played on and changed by mapped videos: an elevation in the surface can thus be a table, the roof of a car, or the surface of a swimming pool, depending on the video overlay. Both large, wide spaces and very narrow, small spaces can be simulated.

The AR, the physical computing components and the video mapping are very closely intertwined. In this way they can influence one another and a physical interaction with the memories becomes possible. During the fellowship, I worked on building the interactive physical elements and programming the network setup. I also tried to find out which video aesthetics are particularly suitable for mapping different interaction modes of the AR application and to build a technically well-functioning network.

My goal was to build a performative event that responds to the activity level and curiosity of the visitors, combining fantastic and realistic elements. Depending on the level of interaction, visitors should be able to experience different narratives of the same story.

Research Questions:

  • How can a workable and inclusive network be installed?
  • Which intersections of digital and physical interactions are interesting?
  • How can an interactive installation be interesting for those who are a little more on the passive side?


Similar Projects

******
******
Christiane HütterMarkus Schubert
InteractivePerformanceNetworked ObjectsSensors2020
Fellowship
PALIMPSEST
PALIMPSEST
Jakob LorenzStella Lennert
VR (Virtual Reality)DramaInteractiveStage Design2022
Fellowship
Humane Methods
Humane Methods
Andrea FamilariMarco Donnarumma
PerformanceArtificial IntelligenceAV (Audiovisual Design)Lighting DesignInteractive2020
Fellowship
Resonance
Resonance
Björn Lengers
InteractiveArtificial IntelligenceSound Design2023
Fellowship
A_live
A_live
Laura Waltz
2023Motion Capture/TrackingDancePuppetryAvatarsSensorsPerformanceInteractiveImmersiveChoreography
Fellowship
Memory of Things
Memory of Things
Nico ParisiusCaspar Bankert
Networked ObjectsObject TheatreInstallationSensors2021
Fellowship
KEEP IT REAL
KEEP IT REAL
Piet Esch
2023HologramsInteractivePerformance
Fellowship
INVISIBLE CITIES
INVISIBLE CITIES
Johannes Bereiter-PayrPeter Lorenz
One on One TheatreInteractiveRoboticsNarrative Design2021
Fellowship
FXKE: Post-Truth Storytelling
FXKE: Post-Truth Storytelling
Jiayun Zhuang and Edwin van Steenbergen
PerformanceArtificial IntelligenceInteractiveData VisualisationAV (Audiovisual Design)2021
Fellowship
Robiotope
Robiotope
MANUFAKTOR
PuppetryInteractiveRoboticsBiological Data2022
Fellowship
Automating the Audience
Automating the Audience
Katie Hawthorne
InstallationInteractiveChat Bots/Service Bots Drama2021
Fellowship
Post-Organic Bauplan
Post-Organic Bauplan
Post-Organic Bauplan
RoboticsSensorsDancePerformanceXR (Extended Reality)2022
Fellowship
AUTO_NOMOS
AUTO_NOMOS
Markus WagnerChristoph Wirth
VR (Virtual Reality)Stage DesignInteractiveAvatarsChoreography2021
Fellowship
Common Grounds
Common Grounds
Kerstin ErgenzingerBnaya Halperin-Kaddari
Installation2022Data SonificationSound DesignSensors
HIDA
multiVRse
multiVRse
Alexander NhamGloria Schulz
VR (Virtual Reality)App/UI DesignNarrative Design2020
Fellowship
connecting:stitches
connecting:stitches
Luise Ehrenwerth
eTextilesCostume DesignAR (Augmented Reality)2021
Fellowship
Sensory Airplanes
Sensory Airplanes
Lukas Rehm
InstallationAV (Audiovisual Design)Sound DesignArtificial IntelligenceOperaXR (Extended Reality)2020
Fellowship
Die Andere Stadt
Die Andere Stadt
Sarah Buser
AR (Augmented Reality)Spatial DesignNarrative DesignInteractive2021
Fellowship
Merging Entities
Merging Entities
Birk SchmithüsenNina Maria Stemberger
Data SonificationChoreographyLighting DesignArtificial IntelligenceSensors2022
Fellowship
Machine Learning in Artistic Production
Machine Learning in Artistic Production
Meredith Thomas
Artificial IntelligenceInteractiveSensorsInstallation
Fellowship
The (Un)Answered Question
The (Un)Answered Question
Martin Hennecke
OrchestraData VisualisationBiological DataInteractive2021Artificial Intelligence
HIDA
Sun Within
Sun Within
Vesela Stanoeva
XR (Extended Reality)InstallationSound Design2020
Fellowship
Hreyfð - wearable gestural instrument
Hreyfð - wearable gestural instrument
Sóley Sigurjónsdóttir
Data SonificationSensorsSound DesignChoreography2022
Fellowship
Realism Playground
Realism Playground
Vivian Lu
InteractiveData VisualisationInstallationStage Design2020
Fellowship
HoloPy³
HoloPy³
Lena Biresch
Game DesignNarrative DesignHologramsDramaXR (Extended Reality)2020
Fellowship