The view from the front: Post with the Pros tackles virtual reality

Post with the Pros pulled together its most impressive roster yet for our virtual reality showcase. Demos from manufacturers HTC, NVIDIA, HP, Imagineer, Dolby and EditShare were followed by an expert panel led by our very own Jamie Allan, featuring Mike Davis (Creative Director at Alchemy VR), Oliver Kibblewhite (Head of Special Projects at Rewind), The Mill’s Creative Technologist Kevin Young and Halo’s Head of Audio Operations, Richard Addis. 

Highlights of the night included workflow tips from EditShare (above and beyond “use EditShare”, they recommend an Adobe editing workflow aided by Mettle’s SkyBox Studio 2 plugin), previews of of NVIDIA’s upcoming offerings (a VR WORKS 360 Video SDK that enables realtime stitching of 4K; Pascal architecture that’s up to 95% faster than the previous generation and capable of rendering out both ‘eyes’ of content for a head mounted display simultaneously), and the chance to try out immersive content from a range of our customers, as well as sampling content from the manufacturers themselves.

Story telling vs story living

While the VR market is growing massively, it’s still a relatively new medium, and our panel were keen to pin down how it should and shouldn’t be employed. Our experts were cautious of projects that treated VR like a new version of 3D TV rather than a unique medium, insisting that it needs to be applied to projects where “you think ‘there’s no way this could be any better in any other technology’.”

Rewind’s in-house philosophy makes a clear delineation between story telling – linear narrative, often delivered via 360 video – and story living – immersive experiences delivered via devices like Oculus Rift and HTC VIVE, where the user chooses their own path through the world and the creator’s job is to make sure that a) there’s somewhere for them to go and b) it can be rendered quickly enough when they get there.

Know your technology

Another challenge posed by VR, and often not realised by clients, was the cost of post-production. Not only is there a lot more footage to process, as rigs can run up to dozens of cameras, but as Mike pointed out, “A lot of people don’t think about the cost of painting things out of shot [when shooting 360]”. In Richard’s experience, “VR is rarely longer than 20 to 30 minutes, but the time you spend in post is far in excess of what you’d spend on a 60 minute TV show.”

The challenges aren’t limited to post-production, however. Different cameras will have fractionally different start times and colour differences that need to be compensated for; different brands have different strengths and weaknesses when it comes to stitching several shots together to make a single VR space, and lengthy testing is needed to find out whether, for example, your actors can walk across one of these stitch lines without their face warping, or if you need to set up very specific marks and limits.

There’s also the fact that stitching the individual camera outputs together to make the final shot can take several days, so a director used to seeing instant playback will have to deal with long delays before they know whether they have the shot they want. (This can be sidestepped by strapping a handful of secondary cameras on top of your rig to give them a very rough onset stitch, according to Oliver.)

Devices and delivery

Richard predicts that over the next few generations, the hardware market for VR – which is currently very segmented – will coalesce, allowing for content to be delivered to multiple devices, or be optimised for one platform “so it’ll be like delivering for PlayStation or Xbox” rather than the current system, in which you need to know your target device and its limitations before you begin pre-production.

Oliver’s hopes for the future include “a target baseline level of controls – your HMD should include some sort of haptic feedback, it should have positional tracking, and you should make sure that you can meet a minimum level of experience, especially for interactive content.”

Is it worth it?

While Mike and the rest of the panel were aware that we hadn’t found “the ‘must-have’ content for home VR, like the Queen’s coronation was for television”, they were adamant that tackling the challenges of VR was worthwhile, and that rather than “3D, which got in the way of TV, which people were already comfortable with”, it offered a unique experience for the viewer that was distinct from any other media they have access to. “People are moved by VR in a way that they’re not by TV,” Kevin told us. “It’s something quite special.”

Here’s the full panel, for anyone interested:

Want to know more about how we can help you incorporate VR? Give us a call on 03332 409 306 or email broadcast@Jigsaw24.com. For all the latest news, follow @Jigsaw24Video on Twitter or ‘Like’ us on Facebook.

Liz
Liz
Call us: 03332 409 306

Leave a Reply

Your email address will not be published. Required fields are marked *