Developing Interactive 360 Video and VR Simulations for Front-Line Food Workers

The “Situational Immersive VR Training” project, a collaboration between SIRT and Closer Collab, aimed to research and develop advanced VR training applications for front-line food service workers. A proof of concept was developed to assess the effectiveness of interactive 360 video and VR simulations in enhancing training.

The project delivered an interactive 360 video module simulating challenging customer interactions, providing a safe environment for decision-making and error correction. Additionally, a VR simulation for assembling sandwiches to industry standards was created using the Unity game engine and custom systems like Event Sequencing and Object Assembly. The application was successfully deployed to VR headsets for client presentation. This initiative showcased VR’s potential for superior, hands-on training, particularly for complex tasks and sensitive customer service scenarios. Extensive documentation was also provided to the client.

Addressing Training Gaps in High-Stress Customer Service Roles

Front-line food workers require effective and engaging training methods to prepare them for various scenarios, including customer interactions and operational tasks. Traditional training approaches, such as videos or manuals, can often fall short, especially when teaching the use of machinery, where hands-on experience is paramount but not always safely or practically achievable in a real-world setting.

The project aimed to address this gap by exploring the usefulness of immersive VR training. This approach provides a secure environment for trainees to practice responses to uncomfortable customer situations, allowing them to make mistakes and learn without real-world consequences, thereby enhancing their preparedness for actual job challenges. Virtual reality stands out as an ideal medium for training on machinery, offering a more intuitive and effective learning experience compared to conventional methods.

A Multi-faceted Approach to Immersive Training

The project produced a working prototype featuring two immersive training formats:

1. 360° Video Scenario
   • Captured with a GoPro Fusion at 5.6K resolution, simulating a customer conflict in a fast-food environment.
   • Post-production involved stitching with Fusion Studio and Premiere Pro editing, with Photoshop used to remove camera rig visibility.
   • A branching decision tree system (Video Branching Scenario or VBS) was built in Unity using a modular event sequencing system. Based on user input, learners viewed different scenario outcomes.
2. VR Simulation (Object Assembly):
   • Created with Unity and the XR Interaction Toolkit.
   • Trainees assembled a virtual burger using drag-and-drop interactions guided by a component-based “Assembler” system.
   • The simulation enforced correct stacking order and item placement using predefined validation logic.
   • Future expansions were discussed for spreading condiments and incorporating machinery training.

Extensive technical documentation was provided, enabling Closer Collab to extend and repurpose the system for future training modules.

Immersive, Repeatable Training Tools for Frontline Staff Development

The final deliverable included a packaged VR app deployed to a headset and two fully developed training modules: a decision-based 360° video experience and an interactive VR sandwich assembly. The branching logic system and object assembler offer a scalable framework for future training expansions. Closer Collab now has a functional proof-of-concept to present to professional stakeholders and industry partners. The system promotes experiential learning, improving retention and preparing workers for real-world challenges in a controlled, safe virtual environment.