Over the last few months, images created by using text descriptions such as DALL-E, ROBOMOJO, DeepDream, and others have dominated the news as more and more non-data science professionals have used the programs to create unique photos and even award-winning artwork. Now, Meta has introduced the next step in the evolution of AI-powered text-based creation, Make-A-Video.
Just as in its namesake, a user simply provides the program with a text description of a scene and it will generate a short video based on what was provided. Even though the video may not be as powerful, or detailed as its cousins in the text-to-image AI world, this is still a new frontier that can empower creators to create original videos by feeding an AI program the text of a scene.
According to Meta’s announcement, the program is unique as it can also use provided images or existing videos from the user to create similar, yet original content. The program is also using publicly available datasets in a bid to provide the community with a significant level of transparency about research related to the program. Make-A-Video also follows Meta’s Responsible AI Framework.
In a post, Meta CEO Mark Zuckerberg introduced the program and announced that the team will have a demo for Make-A-Video, sometime in the near future. In the same post, he also boasted about the program and the difficulty behind artificial intelligence to generate video, “It’s much harder to generate video than photos because beyond correctly generating each pixel, the system also has to predict how they’ll change over time.”
The videos produced by the program are clearly artificially made when viewing them. Many honestly look like old Rankin/Bass Christmas Specials that utilized stop-motion animation. Though this is the case, this is a pretty big leap forward at a time when artificial intelligence is being used more and more in the entertainment sphere.
For example, last week, it was announced that James Earl Jones, a legendary actor, signed away his voice to keep Jedi Sith Lord Darth Vader alive well past his own life by using AI to clone his voice. But it’s not just movies. There was also news about a fully AI-generated video game currently on Steam, This Girl Does Not Exist, which is seeking to revolutionize the way video games are being created. So all in all, we might be living through a renaissance, powered by AI.