Dynamic Digital Human (DDH): Innovating XR Media Production
Research Team
Stephan Kozak
Jason Hunter
Valentina Bachkarova
Others
Partners
Cream Productions
NSERC
OCE
Impact
- Advanced avatar patent
- Formation of interactive department at Cream Productions
- Development of new standard in character creation and animation for XR
The journey to research, develop, and implement Dynamic Digital Human technology
The development of Dynamic Digital Human (DDH) technology represents a significant leap forward in the extended reality (XR) technologies market. This initiative combined innovation, collaboration, and substantial grant support to address challenges and deliver groundbreaking solutions in XR media production, marked by a key international patent application.
The Purpose and Drive Behind DDH Technology
The journey to create the Dynamic Digital Human (DDH) technology was driven by a compelling need to revolutionize the extended reality (XR) technologies market. The aim was to overcome existing challenges in animating avatar facial gestures with unprecedented realism and efficiency. This endeavor was motivated by the potential to enhance user engagement and emotional response in XR environments, thereby setting new standards for character creation and animation. The aspiration was not only to advance media production capabilities but also to open up new possibilities for interactive and immersive experiences in entertainment, education, and beyond.
Innovation, Collaboration, and Support
The path to developing DDH technology unfolded through a harmonious blend of innovation, collaboration, and extensive grant support. Innovation was at the forefront, highlighted by the filing of an international patent application for a cutting-edge character pipeline that significantly advanced avatar facial animation techniques. Collaboration played a key role, with pivotal partnerships, notably with Cream Productions and the backing of the Natural Sciences and Engineering Research Council of Canada (NSERC). These collaborations were essential in refining workflows for creating virtual humans and digital doubles, focusing on the latest advancements in photogrammetry and facial projection mapping. Financial support, primarily through grants from NSERC and the Ontario Centres of Excellence (OCE), underpinned the project’s ambitions. This funding was instrumental in enabling the research and development efforts necessary to push the technological boundaries in facial capture, re-projection, and enhancing user experiences in XR platforms.
Breakthroughs and Achievements
The culmination of this project was the creation and implementation of the Dynamic Digital Human technology, a landmark achievement that has set new benchmarks in the XR industry. This technology has not only advanced the animation of facial expressions in avatars but also established
a new standard in character creation and animation for extended reality environments. By delivering scalable and efficient solutions for the media production landscape, DDH technology has showcased the potential to transform traditional media production paradigms. The technology’s application ranges from enhancing media production at Cream Productions to pioneering immersive gaming experiences with the development of Survivorman VR for PSVR and Oculus Quest platforms. The project’s success is a testament to the power of combining focused research, strategic partnerships, and innovative technology to revolutionize how we interact with digital humans in virtual spaces, marking a significant leap forward for the XR technologies market.