SAN JOSE, CA — Adobe (adobe.com) has introduced powerful new AI and 3D innovations across its family of video and audio applications. AI-powered features help automate time-intensive tasks so video editors and motion designers can bring their visions to life quickly, while dozens of user-requested workflow enhancements help improve productivity.
The beta release of Premiere Pro adds AI-powered features, including “enhance speech” for quicker dialog cleanup, filler word detection and removal in text-based editing, and improved auto tone mapping for more consistent color output. In addition, the timeline is as much as 5x faster.
The enhance speech feature uses AI to remove background noise and improve the quality of poorly-recorded dialogue. User can also use the mix slider to incorporate some of the background noise.
In addition, new audio category tagging uses AI to determine which clips contain dialogue, which contain music, and which are sound effects or ambient noise. When each audio clip is selected, the most relevant tools are automatically displayed.
Premiere Pro introduced text-based editing earlier this year to help make creating rough cuts as simple as copying and pasting text. New improvements include filler word detection, which automatically identifies "ums" and "uhs" in dialogue. Pros can quickly remove those filler words, pauses or any other unwanted dialogue in one step using bulk delete.
Additionally, new color preferences and improved tone mapping make it easier to get great color results. Automatic tone mapping has been improved to include three new tone-mapping methods. There are also new consolidated settings in the Lumetri Color panel, as well as improved LUT management and relinking. Finally, users can ensure that colors look exactly as they expect in QuickTime Player by adjusting the new viewer gamma option.
After Effects (beta) receives next-generation AI rotoscoping to streamline workflows by removing objects faster and more accurately. A new, true 3D workspace integrates 3D models for high quality VFX composites and motion graphics. Users can add depth and dimension to compositions in a unified space with native import of 3D models. Image-based lighting realistically places models into a scene with complementary lighting and shadows using any image as a light source, making objects appear as though they naturally belong there. 3D motion graphics are generated using an advanced 3D renderer. A new way to combine 2D and 3D in a composition has also been added. Effects that reference another layer, such as displacement map, vector blur or calculations, can use a 3D model layer as a source to create stylized renders.
Hard-to-isolate objects, such as overlapping limbs, hair and transparencies, are now separated from their background easier thanks to an all-new AI model in the roto brush tool. With this addition, artists can shave off tedious rotoscoping time.
Adobe also announced new features for Frame.io, including Storage Connect, which accelerates collaboration and cuts costs for enterprise customers needing solutions to scale profitably, allowing them to use the storage they already own, while maintaining full control of their assets. Storage Connect enables direct connection to AWS S3 storage with lightweight proxies available in Frame.io. Storage Connect will be available later this year for Frame.io Enterprise customers.
All Premiere Pro and After Effects features are available now in beta and are planned to be generally available later this fall.