ERLANGEN, GERMANY — The Fraunhofer Institute for Integrated Circuits IIS (www.iis.fraunhofer.de/en) is at the IBC show demonstrating the integration of its light-field plug-in suite in The Foundry’s Nuke. The integration provides professionals with an easy-to-use tool to meet the growing need for processing multi-camera data. Fraunhofer IIS´ light-field technology enables professionals to take advantage of multi-camera array data based on a single shot in post production to provide advanced editing, special effects and other creative possibilities previously only possible with CGI.
“Fraunhofer IIS’ research is dedicated to providing easy-to-use, cost-effective and future-proof solutions that will open any digital media or cinema workflow to new creative possibilities that provide audiences with the high quality and immersive viewing experiences they demand,” explains Frederik Zilly, head of group Computational Imaging of Fraunhofer IIS.
To make the editing and special effects post processes simpler and less resource-intensive, studios are turning to the use of multi-camera systems. The cameramen, in addition to the main camera system, use arrays consisting of multiple cameras in various arrangements. This enables multiple viewpoints to be recorded on-set in a single shot. With the right technology, data from the multiple camera streams can be manipulated in post production to enhance the main shot in various steps, or can be used to adapt or change the scene. Fraunhofer IIS’ light-field technology does just that.
Fraunhofer IIS’ light-field plug-in suite enables various camera views to be calculated to create virtual camera movement, a change in the depth of field or a shift in zoom all in post. Images from multi-camera arrays in a grid-like arrangement can be used as input material. Furthermore, data from these arrays is processed via disparity maps, which can be used as the basis for producing new depth maps for color correction and matting for flawless virtual backlots. Relighting is also possible.
Fraunhofer IIS is looking for professional first adopters who would like to test the tools in their productions. A test-shoot with Stuttgart Media University, titled Coming Home, showcasing the capabilities of light-field technology for live-action filming, can be viewed at: www.iis.fraunhofer.de/lightfield.