
Exploring Immersive Experiences for Canada’s Performing Arts
Research Team
Jason Hunter
Kevin Santos
James Rowan
Emerson Chan
Partners
Ballinran Productions Limited
NRC IRAP
CTO
Impact
- Multi-format prototypes: 2D, 360, and 3D volumetric capture.
- Workflows for virtual humans and post production.
- Scalable digital pipeline for performing arts.
Holostage Concept Definition
The HoloStage concept definition project aims to establish how various capture technologies could be harnessed as an enhancement for Canada’s performing arts sector to form part of the immersive applications being developed by Stageview.TV, Canada’s new streaming platform for the performing arts.
HoloStage: A Holographic Symphony is designed to be a key component of Stageview.TV’s ability to collaborate with performing arts companies across Canada to advance their ability to embrace digital innovations for both in-person experiences and those accessed digitally or virtually. The project involved conducting research to establish a workflow for generating three-dimensional performance data of a symphony conductor, synchronizing their action with previously pre-recorded music. Over the course of the project a variety of data types were captured to function as a baseline sample data set of performances that can be used for integration into the online deployment of the Stageview.TV platform.
The primary key focus of the project was on the development of a performance capture workflow for recording volumetric 3D data. During the project a digital double of a live performer was created using reality capture techniques to precisely capture a person’s likeness. 3D scan data was then reconstructed and processed for Unreal Engine. Performance capture data was retargeted to the virtual human for further testing and deployment to Unreal Engine.
