In summary
- Meta will bring Movie Gen to Instagram, allowing you to edit videos with text to change backgrounds, outfits and more.
- Movie Gen incorporates video inpainting, keeping elements intact while altering others, such as backgrounds or visual styles.
- The tool will compete with video AI solutions such as OpenAI’s Sora and Google’s Veo2.
Meta is bringing its AI video tricks to Instagram, with new features that will let users modify their videos simply by using text to modify images—from adding objects to changing backgrounds, and doing just about anything you can imagine.
“I’m very excited about Movie Gen, our early AI research model that will let you change almost any aspect of your videos with a simple text command,” said Instagram director Adam Mosseri in an announcement video.
In the video, Mosseri appears in his original clothing and location—a gray jacket and a normal-looking bedroom—and the setting begins to change randomly, showing him in Paris, New York, and a pool, and changing his clothing to different items such as a leather jacket or a bulky sweater while in the Himalayas.
“You should be able to change your outfit or change the context you’re sitting in, add a chain, or whatever you can think of,” Mosseri explained, showing demos where he seamlessly changed backgrounds and transformed his appearance.
Meta announced Movie Gen a few months ago, showing off some generations that surpassed other models’ outputs in quality and adherence to instructions. The company also showed off some AI-generated Instagram Reels created by influencers like Paige Piskin and social media brand 10pm Curfew’s Girls and K5sh accounts.
Beyond generative video, Movie Gen handles video inpainting—altering specific things within a video while keeping all other elements intact. This makes the model extremely versatile and gives users the ability to perform different visual manipulations—from changing a person’s outfit to swapping backgrounds, and even transforming people into puppet-like cartoon versions by manipulating the overall style of the scene.
The technology appears to be based on Meta’s Movie Gen AI model, which Decrypt reported last year. It’s the company’s response to similar tools from rivals, such as OpenAI’s recently announced Sora video generator, Runway’s inpainting feature, and even some open source tools like Propainter.
For Instagram, this is the first time Meta has brought its video AI capabilities directly to users. Movie Gen can create entirely new 16-second videos or modify existing ones, with synchronized sound effects and music.
The generative video scene has been booming lately, with very important developments announced in recent months after a somewhat quiet year with spaced out releases.
Sora is already available, but there have been many interesting alternatives—such as Invideo V3 (able to generate entire scripts, scenes and 10-minute long videos from a single idea), Dream Machine (which can generate coherent and realistic videos even in surreal scenarios), Google’s Veo2 (capable of generating very realistic videos with great adherence to prompts) and Showrunner (which can generate small cartoon sketches).
Meta hasn’t announced a specific release date, but Mosseri said it will arrive in 2024.
Edited by Andrew Hayward
Generally Intelligent Newsletter
A weekly AI journey narrated by Gen, a generative AI model.
For the Latest Crypto News, Follow ©KeynoteUSA on Twitter Or Google News.
Disclaimer: Please note that the information provided on this page is for News purposes only and should not be considered investment or trading advice. ©Crypto.keynoteusa.com strongly recommends that you conduct independent research and/or consult with a qualified professional before making any investment decisions.
