Volumetric capture can record footage of a real person from various viewpoints, after which software analyzes, compresses, and recreates all the viewpoints of a fully volumetric 3D human, says Ravi Velhal

Developers and content creators use Intel hardware and software technologies to capture and process immersive digital assets for video games, virtual and augmented reality, holograms, film and other rapidly growing markets. Forecasters expect the volumetric video market to grow from $578 million in 2018 to nearly $2.8 billion by 20231. Read on to learn how Intel engages with film studios and innovative developers to bring volumetric video experiences to life.

TechCrunch explains that volumetric capture can record footage of a real person from various viewpoints, “after which software analyzes, compresses, and recreates all the viewpoints of a fully volumetric 3D human.” It can be described as “depth to point cloud from capture” or creating a point-cloud from frames. Volumetric video plays it back into video format.

Developers and content creators around the world see growing opportunities with this technology. Markets include architectural design, public safety, retail point-of-sale, gaming, mass-media entertainment, and many other exciting application areas.

Storytelling Meets Technology

At Cannes film festival Ravi’s keynote and panel session highlighted the power of production technologies to create multisensory immersive cinema experiences and Hollywood volumetric cinema productions. In the era of next-generation immersive cinema, storytelling and technology combine in a data-powered entertainment landscape.

Audiences respond strongly to the power of immersive cinema storytelling. You can see, hear, feel, experience and even smell that in the multisensory Intel collaboration, prelude to LeMusk by A.R. Rahman (double Oscar winner musician, composer, well-known for his hit film Slumdog Millionaire). Intel also collaborates on a growing number of exciting Hollywood productions, including SpiderMan: Homecoming VRE, Save Every Breath: Dunkirk VRE by Warner Bros., First Man: VRE by Universal Pictures, and SpiderMan: Far From Home multiplayer VRE over 5G at MWC 2019 and the summer blockbuster, SpiderMan: Far from Home VRE by Sony Pictures.

Intel Studios and “Grease” at 40

A key milestone in the transformation of Hollywood was on January 8, 2018. That day, Variety reported on the opening of Intel Studios, a dedicated volumetric video capture facility. The story summed everything up nicely by saying, “Intel wants to help Hollywood embrace the next generation of immersive media … essentially producing high-end holographic content…”

Intel Studios’ general manager Diego Prilusky and Randal Kleiser, the director of the 1978 iconic movie “Grease,” revealed at CES 2019 an exploratory, immersive teaser celebrating the film’s 40th anniversary. Growing up with Song and dance Bollywood influence , Ravi initiated Grease project with Randal Kleiser and Paramount Pictures. A little more than a year later, at the Cannes Film Festival/CannesXR 2019 event, Intel and Paramount Pictures released the five trillion pixel, full-volumetric experience based on a re-creation of the iconic song “You’re the One That I Want” for PCs and AR devices.

Advancing Data-Driven Storytelling with Sony Pictures Entertainment

In June 2018, Sony Pictures Entertainment (SPE) launched Sony Innovation Studios in collaboration with Intel, Dell, and Deloitte Digital. Housed in a 7,000 square-foot sound stage on the Sony Pictures Studio lot in Culver City, Calif., the space features the latest in research and development in areas including volumetric video and customizable set scanning. Sony Innovation Studios works with engineers throughout Sony Corporation and pursues business development opportunities in motion pictures, television, music and gaming. Intel has teamed up with Sony Pictures to help expand the applications of Sony Innovation Studios beyond entertainment to other market segments. With Sony Innovation Studios, enterprises can leverage emerging technology to visualize real business solutions and solve problems within their industries.

Most recently, Intel teamed up Sony Pictures Virtual Reality to bring the Spider-Man™: Far From Home Virtual Reality Experience. This experience gives players the chance to select their favorite Spider-Man suit, and, for the first time, swing high above New York City. The short VR gaming experience was developed by CreateVR using Intel® Xeon® Scalable processors. In addition to the VR experience, Intel worked with Sony Innovation Studios to capture Tony Stark’s jet with volumetric technology using a point cloud system and processed using Intel Xeon Scalable processors. Watch the Behind the Screens video about the making of the VR experience and a sneak peek into Tony Stark’s volumetric scanned jet.

Humanizing the Digital World

As glamorous as our work with Hollywood studios and world-famous directors may sound, some of the greatest value comes from developers and technology innovators like Underminer Studios.

Underminer’s Volumation product uses cost-effective technology to capture, optimize, and perform post-production clean-up in one process, without a green screen. It can increase realism and immersion and lower the barriers of accessibility and cost for 3D images of real humans or objects in motion.

Volumation was introduced at SIGGRAPH 2018 by Alex Porter, CEO of Underminer Studios. She described the opportunity for real world assets, objects, and people to be put into digital formats, as “humanizing the digital world.”

After a few initial designs, the rig for the Volumation demo at SIGGRAPH included 26 Grove* UP* boards and 128 cameras. Technologies used included Intel® NUC™ PCs, HTC* Vive* VR, Intel® Optane™ memory/storage, Google* ARCore* AR, Unity* real-time 3D, Intel® networking, Intel® Graphics Performance Analyzers (Intel® GPA), and of course, it all ran on Intel® CPUs.

Capture the Opportunity

Intel works with leading companies to ensure the creative software you rely on performs at its best, so you can get through production work faster and have more time to develop your next great idea. Get practical ideas on ways to adopt immersive technology for a range of markets at the Intel® Developer Zone/VR.

THOUGHT LEADER

Ravindra aka Ravi Velhal leads Digital Media Standards, Technologies and Immersive Cinema programs globally at Intel.

As a Cinema Virtual Reality Experience (VRE) pioneer, he co-produced Le Musk multi-sensory VR by A.R. Rahman, Save Every Breathe: Dunkirk VRE with Warner Bros, FIRST MAN: VRE with Universal Pictures and RYOT, directed Rio Carnival 2018 VRE with GloboTV, collaborated with Sony Pictures on SpiderMan: Home Coming VRE which was nominated for prestigious Emmy, and he recently launched Innovation Studios with Sony Pictures. At Mobile World Congress in Feb 2019, he collaborated with Sony Pictures to launch SpiderMan: Far From Home, the world’s first multiplayer VRE gaming experience over 5G. His focus is to drive future immersive cinema, including future media formats. Ravi is recipient of Hollywood’s prestigious Lumiere award, Infinity Film Festival of Beverly Hills Audience Choice Award. Ravi holds several global patents, and he has served as a director on the AIS/VR Society board, and an advisor to film and trade organizations, globally.