Adobe Premiere Pro, full steam ahead on generative AI. A few days ago we talked about the US company’s commitment to creating a video generation service from OpenAI’s Sora-style text prompt.
Soon, Adobe announced the Innovations planned for this year in Premiere Pro which will allow users to simplify the editing of all videos, including adding or removing objects in a scene or extending an existing clip. These editing workflows will be powered by a video template that will join the Firefly family, including Image, Vector, Design, and Text Effects.
“Adobe is continuing to develop Firefly AI models in areas where it has deep expertise such as image editing, video, audio and 3D and will increasingly integrate these models into Creative Cloud and Adobe Express,” says know the company.
Not only that, Adobe wants to bring third-party generative AI models directly in Adobe applications like Premiere Prothus making it “a more versatile and extensible professional video tool that adapts to any workflow.”
In its press release Adobe mentions the video generation models of OpenAI and Runway“integrated into Premiere Pro, to generate B-roll to edit in their projects. Furthermore, it is also shown how Pika Labs could be used with the Generative Extend tool to add a few seconds to the end of a shot.”
“Adobe is reimagining every step of the video creation and production workflow to empower creators to bring their work to life,” said Ashley Still, Senior Vice President, Creative Product Group at Adobe.
“By bringing generative AI innovations into Premiere Pro workflows, we are solving the real problems that video editors experience every daygiving them more space to focus on what’s really important.”
Among the upcoming features is Generative Extenda solution that adds frames seamlessly stretches clips, making it easier to optimally synchronize edits and add smooth transitions.
This innovative technology solves a common problem that professional editors face every day, allowing them to create additional media files to sharpen edits, to fix a shot for an extra shot or to better cover a transition.
Another new thing is “adding and removing objects“, where you simply select and track objects, then replace them. You can remove unwanted objects, change an actor’s wardrobe, or quickly add props like a painting or photorealistic flowers to a desk.
Adobe also talks about the aforementioned “Text to Video“. “Thanks to this feature you can generate completely new footage directly within Premiere Pro. Simply type text into a prompt or upload reference images. These clips can be used to ideate and create storyboards, or to create B-roll to augment live action footage.”
In addition to Adobe’s new generative AI video tools, New audio workflows will be available in Premiere Pro in May, which will give editors everything they need to have more control and improve audio quality. The new features include:
- Interactive fade handles: Editors can create custom audio transitions faster than ever by simply dragging clip handles to create audio fades.
- New Essential Sound badge with audio category labeling: AI automatically labels audio clips as dialogue, music, sound effects or ambience and adds a new one
- Effects badges: New visual indicators let you easily see which clips have effects, quickly add new ones, and automatically open effect parameters directly from the sequence.
- Redrawn waveforms in the timeline: Waveforms intelligently resize when clip tracks change, while new colors make sequences easier to read.
Additionally, the Enhance Speech tool has been available since February, which instantly eliminates unwanted noise and improves dialogue.
Tags: Adobe Premiere Pro artificial intelligence takes whats
