Virtual Production demo (Unity): Antilatency camera tracking

[ohheylilly]

Hi there, fellow EOSHD forum members. I wanted to talk a bit about Virtual Production (hope there are a few interested people). Setting up a VP studio can be quite overwhelming, especially when choosing a tracking system. There are several options to choose from, and we've made this quick demo to show how to use Antilatency with Unity. You can track cameras, objects and even body parts.

In this case, we have used a tracking area attached to the truss system, one tracker for the camera, and two trackers for each leg. All tracking data was transmitted to Unity via proprietary radio protocol, and was used for real-time rendering. We didn't use any post-processing or cleanup — only real-time data.

I would love to hear what you and Andrew think of it - this demo and Virtual Production in general. We’re also open to suggestions on what demos we should do next!

[majoraxis]

@ohheylilly Welcome!

We have a number of members who are interested in Virtual Production. Here's a topic for your review:

 

As some people on this forum have professional cameras, lenses, focus and zoom controllers, lighting and green screens, if you would provide an example our how your system works for a non stationary camera (dolly or hand held) in relation to a non stationary subject (distance relative to the camera and focal distance is changing as well as the operator changing the the zoom setting) and a green screen background that gets replaced by a virtual background that changes its perspective and depth of field based on the relationship of the subject to the camera, the realtime reporting of the zoom and focus positions of manual zoom lens using the AFX system by our very own BTM_Pix, and in Unreal Engine 5.  That would be greatly appreciated.

What makes up a camera tracking system for virtual production from antilatency and how does it compare feature and cost wise to other professional camera tracking systems?

Thanks for your interest in our forum and our virtual production needs!

 

[ohheylilly]

Thank you for your reply, we'll see what we can do to share more demos that might be of interest for the community. And we haven't worked with AFX before, but we're excited to reach out to BTM_Pix to see if we can maybe set something up together

[majoraxis]

Thanks Lilly,

Looking forward to what you come up with!

If you want to get us started with the second question about what makes up a camera tracking system for virtual production from antilatency and how it compares feature and cost wise to other professional camera tracking systems the would be a great place to start...