VRinMotion

Investigates how characteristics of stop-motion animation and motion-capturing can be conflated with virtual reality in order to enrich the current art discourse.

Background

Stop-motion is an analogue animation technique, where the illusion of motion is created by changing or shifting objects manually in small steps and projecting these changes as a sequence of individual photographs (or frames) onto a screen. Motion capturing (mocap), on the other hand, are tracking techniques that are employed to capture or record patterns of movement; in recent times mainly for the purpose of animating a digital character in a film. Both techniques have already been in use at, or even before, the beginning of film-history and always have encouraged intermediality (i.e., merging different artistic spheres such as photography, music, fine arts, performance and theatre).

Virtual reality dates back to the 1960s and is either described as an immersive-mental experience, as a three-dimensional display, an interaction device or as an innovative form of human-machine interaction. Irrespective of its exact definition technologies enabling virtual or augmented realities (VR/AR) have seen an upswing in the past years. This left its marks in commercial products (e.g., in the game industry) but also inspired artists who strived to translate their creative vision into virtual, augmented and mixed realities.

Project Content

The framework of the project VRinMotion not only builds on stop-motion, motion-capturing and virtual reality but also covers an extensive and heterogeneous field. It incorporates animation, media arts and media performance as well as expanded cinema. The latter describes film, video, multi-media formats and immersive environments that go beyond the traditional one-way relationship between audience and performance. VRinMotion also takes inspiration from animation studies, where the difference between practitioner and theorist is rather seen as gradual than as categorial. Overall, VRinMotion combines different analogue stop-motion techniques with motion capturing, implements the outcomes within virtual reality set-ups and weaves artistic virtual experiences philosophical, theoretical and analytical concepts, models and methods of animation studies together.

Goals

  • We extract stop-motion and motion-capture from a linear context and implement it into interactive virtual environments.
  • By combining stop-motion and motion-capturing with VR, we create a set of hybrid artistic tools and workflows that will spark new ideas for animation artists in VR.
  • We intend to bring performers and spectators/collaborators closer together by systematically exploring possibilities to connect artistic processes and/or performances of the creators directly to the experience of the spectators/collaborators during the act of creation.
  • We push the boundaries of artistic stop-motion and motion-capturing in VR, expanded animation, media arts and performance. We contextualize the artistic virtual and hybrid experiences with philosophical, theoretical and analytical concepts.

Methods and Outcomes

VRinMotion is hosted by the Institute Creative\Media/Technologies (IC\M/T) at the St. Poelten UAS and strongly supported in its endeavours by Vienna-based artist studio lichterloh. During the project four experiments (ExperiMotions) are set up, which subscribe to the principles of Henk Borgdorff’s definition of arts-based research (comprising theoretical Research on the Arts, technical Research for the Arts and practical Research in the Arts). Also, artistic workshops are developed together with internationally established animation artists, national and international collaborators and students. This aims to strengthens the ties between artists from different backgrounds and the outreach of Austrian artists. All ExperiMotions produce artistic output, hybrid instruments, and theoretical contextualizations. VRinMotion initiates broad discussions of the outcomes with academia but also with the wider public. To facilitate this, we organize an exhibition and a symposium (inMotion Forum) and create online presentations and a documentation.

Talk by Franziska Bruckner: Between the Frames: Expanding Stop-Motion for Virtual and Hybrid Environments at Expanded Animation. Mapping an Unlimited Landscape, Ars Electronica Center, Linz. (2022, September 9)

Publications

Salhofer, J., Bruckner, F., Gürtler, C., Husinsky, M., Nebel, S., & Öhner, V. (2024). Interactive Impulses in VR: A Modular Approach to Combine Stop-Motion Animation and Experimental Puppeteering in a Narrative Virtual Environment. 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 90–96. https://doi.org/10.1109/VRW62533.2024.00022
Vasof, A., Bruckner, F., Gürtler, C., Schmid, C., Husinsky, M., Zeller, M., Munk, C., Salhofer, J., Schoiswohl, P., Brullo, R., Nguyen-Thi-Minh, H., & Schmidt, R. (2024). VRinMotion – ExperiMotion 3 [VR – Installation].
Gürtler, C., Nebel, S., & Salhofer, J. (2023, September 22). Wie kann mittels analoger Animationstechniken eine virtuelle Welt im Erdinneren zum Leben erweckt werden? [Demo]. Forschungsfest Niederösterreich 2023, Wien. https://www.noe.gv.at/noe/Wissenschaft-Forschung/Forschungsfest_Noe.html
Kirschner, F., Salhofer, J., & Voegelin, L. (2023, September 10). Animating a Concept: employing stop-motion and puppetry lenses for more-than-human experiences [Invited Talk].
Franziska, B. (2023, June 14). VRinMotion: Experimental Stop-Motion and Puppeteering in Virtual Environments [Vortrag]. Society for Animation Studies 34th Annual Conference – The Animated Environment, Online – Glassboro. https://www.sas34.org/
Bruckner, F., & Salhofer, J. (2023, June 6). Redefining Animated Frames for Virtual Environments [Vortrag]. World Festival of Animated Film - Animafest Zagreb 2023, Zagreb, Croatia. http://www.animafest.hr/en/2023/side_event_pro/read/redefining_animated_frames_for_virtual_environments_franziska_bruckner_st_polten_university_of_applied_sciences_austria_julian_salhofer_st_polten_university_of_applied_sciences_austria
Bruckner, F., & Salhofer, J. (2023, March 26). Artistic Exploration of Stop-Motion Animation in Virtual Reality: Spatializing the Analog Techniques of Replacement, Cut-Out, and Object Animation [Online Vortrag]. IEEE VR ANIVAE Workshop Series on Animation in Virtual and Augmented Environments, Shanghai.
Bruckner, F., Salhofer, J., Gürtler, C., Hattler, M., & Husinsky, M. (2023). Artistic Exploration of Stop-Motion Animation in Virtual Reality: Spatializing the Analog Techniques of 2D Replacement and Object Animation by Using Digital Cutout and Realtime Rendering. 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 7–12. https://doi.org/10.1109/VRW58643.2023.00009
Kirschner, F., Vögelin, L., Bruckner, F., Gürtler, C., Schmid, C., Husinsky, M., Zeller, M., Munk, C., Salhofer, J., Schoiswohl, P., Brullo, R., Nguyen-Thi-Minh, H., Rauch, M., & Schmidt, R. (2023). VRinMotion – ExperiMotion 2 [VR – Installation].
Stefan, N., & Julian, S. (2023). VRinMotion – ExperiMotion 1 [VR – Installation]. http://www.animafest.hr/en/2023/side_event/read/vrinmotion_experimotion_1
Bruckner, F. (2022, November 11). Spatiality of Cut-Out Animation in Virtual Environments [Vortrag]. Dimensions of Animation, Hochschule Luzern. https://blog.hslu.ch/dimensionsofanimation/
Bruckner, F. (2022, November 9). Between the Frames: Expanding Stop-Motion for Virtual and Hybrid Environments [Invited Talk]. Expanded Animation. Mapping an Unlimited Landscape, Ars Electronica Center, Linz. https://ars.electronica.art/planetb/de/expanded-hybrid/
Hattler, M., Petersen, S., Schmid, C., Bruckner, F., Gürtler, C., Husinsky, M., Zeller, M., Jalaeefar, A., Munk, C., Salhofer, J., & others. (2022). VRinMotion–ExperiMotion 1. Dimensions of Animation.
Hattler, M., Petersen, S., Schmid, C., Bruckner, F., Gürtler, C., Husinsky, M., Zeller, M., Jalaeefar, A., Munk, C., Salhofer, Schoiswohl, P., Brullo, R., & Horvath, P. (2022, 18.11). VRinMotion – ExperiMotion 1. https://blog.hslu.ch/dimensionsofanimation/programme/
Bruckner, Franziska. (2021, June 24). VRinMotion – Expanding Stop-Motion and Motion-Capture in Virtual Environments [Invited Talk]. The Visuality of Virtuality – Documenting Digital Animation Workshop on New Technologies, Forms and Genres of Animation, Ruhr Universitäte Bochum – Online. https://das-dokumentarische.blogs.ruhr-uni-bochum.de/en/visuality-of-virtuality/

You want to know more? Feel free to ask!

Senior Researcher
Media Creation Research Group
Institute of Creative\Media/Technologies
Department of Media and Digital Technologies
Location: A - Campus-Platz 1
M: +43/676/847 228 674
External project manager
Christoph Schmid
Clemens Gürtler
External Staff
Max Hattler
Friedrich Kirschner
Sune Peterson
Anna Vasof
Leonie Voegelin
Raul Maia
Paul Wenninger
Julia Püringer (former staffmember)
Arian Jalaeefar (former staffmember)
Peter Schoiswohl (former staffmember)
Partners
  • Universität für angewandte Kunst Wien (Anna Vasof)
  • School of Creative Media Hong Kong (Max Hattler)
  • HfS Ernst Busch Berlin (Friedrich Kirschner)
  • NTU Singapur (Hannes Rall)
  • Filmuniversität Babelsberg KONRAD WOLF (Frank Gessner)
  • Loughborough University (Paul Wells)
Funding
Austrian Science Fund (FWF)
Runtime
01/01/2022 – 12/31/2024
Status
current