tm logo

Google VideoPoet: Setting The Next Frontier in the Generative AI Race?

Amrusha Chati

Amrusha Chati

08 January 20242 min read

share this blog

Google VideoPoet: Setting The Next Frontier in the Generative AI Race?

The previous year, 2023, was a landmark year for generative AI. Companies across the world launched into a race to create rivals to ChatGPT. Meanwhile, businesses rushed to integrate AI into their processes.

Most of these efforts were focused on creating a Large Language Model (LLM) like ChatGPT and Google's Bard. In the second half of 2023, image generation platforms like Dall-E and OpenAI's Stable Diffusion took center stage. 

It seems 2024 may be the year of AI-powered video generation platforms. Google's newest offering, Google VideoPoet, signals a shift in focus towards video generation. Could video be the next frontier in the generative AI race to stay one step ahead?

Here's a look at VideoPoet and what its video generation capabilities are. 

What is Google VideoPoet?

Person thinking cartoon

Google VideoPoet is currently a research project. It explores the potential of LLMs to generate videos and visual content. It leverages the ability of LLMs to understand and interpret text, translating it into images and sounds that create video clips.

In its trademark application to the US Patent and Trademark Office (USPTO), Google has described it as "providing non-downloadable software using artificial intelligence for creating and generating:

  • Text-to-video 
  • Image-to-video
  • Video stylization
  • Video inpainting and outpainting
  • Video-to-audio
  • Video-to-audio machine-learning-based language
  • Image, video, and audio-generating software
  • Statistical learning
  • Mathematical learning
  • Supervised learning
  • Video editing"

The application also lists "research and development services" in many of these fields.

This means that Google VideoPoet can perform various video generation tasks for applications. These could include:

  • Storytelling

Generating explainer videos, animating stories, or visualizing historical narratives.

  • Concept Visualization

Illustrating ideas, showcasing product features, or prototyping designs.

  • Social Media Content

Creating engaging video clips for platforms like Instagram or TikTok.

  • Artistic Exploration

Experimenting with animation, creating abstract visuals, or generating short films.

  • Image-to-Video

Transforming still images into video sequences, adding movement and context.

  • Video Editing

Extending existing videos by adding new scenes or characters based on textual instructions.

  • Audio Generation

Creating soundtracks that complement the generated video, as well as editing audio clips.

Challenges and opportunities

VideoPoet is still under development. But its text-to-video generation capabilities hold promise for the future of content creation.

  • Democratization of Video Production: Making video creation more accessible to a wider audience.
  • Real-time Generation: Generating video on the fly, potentially in response to user input.
  • Personalized Content: Tailoring video content to individual preferences.
  • Interactive Storytelling: Creating immersive and interactive video experiences.

While these are exciting opportunities, AI-generated content also raises concerns on many fronts. Thus, it's important to keep in mind considerations such as:

  • Copyright and Intellectual Property:

Ensuring proper attribution and addressing potential misuse of copyrighted material.

  • Ethical Implications:

Considering the potential for bias and misinformation in AI-generated content.

  • Responsible Development:

Ensuring responsible development and use of AI tools like VideoPoet.


Google VideoPoet is a significant development in AI-powered content creation. Its capabilities offer exciting possibilities for storytelling, communication, and artistic exploration. As the research continues, addressing the associated challenges and ensuring responsible use will be crucial for unlocking the full potential of this technology.

Google Videopoet trademark listing

share this blog

Amrusha is a versatile professional with over 12 years of experience in journalism, broadcast news production, and media consulting. Her impressive career includes collaborating extensively with prominent global enterprises. She garnered recognition for her exceptional work in producing acclaimed shows for Bloomberg, a renowned business news network. Notably, these shows have been incorporated into the esteemed curriculum of Harvard Business School. Amrusha's expertise also encompassed a 4-year tenure as a consultant at Omidyar Network, a leading global impact investing firm. In addition, she played a pivotal role in the launch and content strategy management of the startup Live History India.