Pt3 - Transition to XR
Spring 2022 - The components for our video wall finally arrived and we’ve been able to assemble our extended reality (XR) studio and start learning about all the moving parts that allow us to mix Unreal Engine with our new video wall. In this first semester there are already three student projects utilizing the new XR studio, with weekly visitors from around campus.
During this semester I’ve also helped faculty document and refine our processes based on the technical learnings in these three projects. Our virtual production journey at LSU can be found on Github.
Smoky
This project revisited our first virtual production test: Mustang Garage. The original project tested out Unreal Engine’s Composure and Sequencer as movie making tools using a green screen to composite directly in UE4. In Smoky, we replaced our green screen setup with filming in front of a ROE video wall and worked towards combining virtual and in-camera layers in Assimilate LiveFX.
My primary roles in this project included:
setup and operation of UE4 with Switchboard and Perforce
setup of our 8-camera Optitrack motion tracking system and calibrating lens focus tracking
storyboard, DP and Red Komodo operation
assembly and editing
UE Composure Foreground
UE Composure Background
Camera View
Composited Layers
The Snow
The first undergrad class to use the new XR studio was Art 4240; a multidisciplinary team of Digital Art, Computer Science, Screen Arts, and English majors. This was our first real test, ensuring smooth operation of the studio’s resources so this class could capture their short film.
This short combined student-made virtual environments, physical stagecraft, and even real-world 360 video.
My primary roles included:
VP Supervisor
mentoring the tech art team
providing physical and virtual lighting/camera support
Get Ready With Me
This project was created by fellow DMAE gaduate students Bailey Barnes and Mel Cotchery. This concept illustrated an augmented reality shopping experience with dress assets that Bailey modeled in Marvelous Designer and then retargeted for UE4. Aside from Bailey and her phone, the environment and props are all UE4 assets. displayed on the video wall.
My contributions to their project included troubleshooting UE4/Switchboard, motion-tracked camera operation, and minor storyboard and creative direction.