Meta unveils AI video models, as tech giants race to produce Hollywood-style clipsMeta unveils Movie Gen -- its most advanced effort to create video clips from text prompts
https://www.washingtonpost.com/technology/2024/10/04/meta-ai-text-to-video/A baby hippo swims in a lagoon. A fire dancer performs on a beach as waves crash into the shore. A DJ plays tunes on a turntable.
Those are Hollywood-style movie clips produced by Meta’s new AI models, which can transform text to video from a simple prompt.
The technology, called Movie Gen, uses two new foundational AI models the company highlighted in a research paper Friday that enable users to make custom movies, edit videos, and create a video using a person’s image.
“We really wanted to improve the state of the technology,” said Ahmad Al-Dahle, vice president of Meta’s generative AI division.
They [are] exceeding our expectations on quality in terms of natural motion or aesthetics.”
Meta is not yet releasing Movie Gen to users, or providing the models open-source to developers, but it is making the evaluation data on the underlying prompts available to researchers to review.
The race to create AI models that can generate video is heating up. In February, OpenAI unveiled its own text-to-video model called Sora, which the company says can produce eye-popping videos that are up to a minute long. In May, YouTube debuted Veo, a video generation model, and Imagen 3, new text-to-image model that the company says will “support the creative process.”
Movie Gen follows similar cinematographic efforts from Meta including Make-A-Video and Emu Video, which generate less advanced videos from text.
Meta’s new model is expected to power future products that could enable creators to share more AI-generated content on its social media networks. The company has pushed out new AI tools in recent months to allow users to create their own chatbots, alter silly images of themselves, and birth imaginary scenes from text prompts.
But some critics have argued that easy AI video tools could open the floodgates to misinformation online and hurt the job market in Hollywood.
While some of the biggest studios have long relied on artificial intelligence to help create sophisticated cinematic effects, the latest advances in generative artificial intelligence have provoked fears among actors that the technology could eliminate jobs.
Al-Dahle said video generation tools will include a watermark that identifies them as generated using artificial intelligence.
Meta said Movie Gen can produce high-quality HD videos of up to 16 seconds from a text prompt and can create videos featuring a specific person, as depicted in a photograph. The model also allows people to edit existing videos with simple text prompts, such as adding thundercrack sounds or tinsel streamers to a lantern, according to the research paper.
“They have the ability to do what we call very precise editing,” Al-Dahle said. “So if you’re asking to edit, for example, a tree and remove it, we only remove the tree.”
AI-Nano-metal進化するナノ液体金属+目撃の記録CA5
Megalophobia images with unsettling music (AI Generated)
Teraphobia images with unsettling music (AI Generated)
AI Generates Monsters that should be in Movies!
Seeing Just How Weird AI Can Get...
A CGI 3D Short Film: "Ouroboros" - by Creative Seeds | TheCGBros
Apocalypse I AI Sci-Fi Short Film
ECHO - Ai Sci-Fi Short Film
I WANT TO BE | AI Short Film | Runway Gen-3, Midjourney, Luma Dream Machine, Hedra AI, Elevenlabs
AI Generated Short Film - Awakening
AI Generated Short Movie - The Final Act
The Coldest Heart - AI assisted Sci-Fi Steampunk short film
Dreams - a vanishing story (AI Short Film)
The Terra Age | AI Short Film
AI SCENES - Tensegrity - AI Generated Short Video 17
AI SCENES - PRIEST - AI Generated Short Video 29
The Matrix - Walking Between Worlds | AI Short Film
Total Posts: 9597