January 29, 2024
1 min read

Google’s latest AI Lumiere creates videos from images

The design facilitates a wide range of content creation tasks and video editing applications, including image-to-video, video inpainting, and stylised generation…reports Asian Lite News

Google has introduced a new video generation AI model called Lumiere that uses a new diffusion model called Space-Time-U-Net, or STUNet. Lumiere creates 5-second videos in one process instead of putting smaller still frames together.

This technology figures out where things are in a video (space) and how they simultaneously move and change (time).

“We introduce Lumiere — a text-to-video diffusion model designed for synthesising videos that portray realistic, diverse and coherent motion — a pivotal challenge in video synthesis,” said Google researchers in a paper.

“We introduce a Space-Time U-Net architecture that generates the entire temporal duration of the video at once, through a single pass in the model,” they wrote.

The design facilitates a wide range of content creation tasks and video editing applications, including image-to-video, video inpainting, and stylised generation.

Lumiere can perform text-to-video generation, convert still images into videos, generate videos in specific styles using a reference image, apply consistent video editing using text-based prompts and create cinemagraphs by animating specific regions of an image.

The Google researchers said that the AI model outputs five-second-long 1024×1024 pixel videos, which they describe as “low-resolution.”

Lumiere also generates 80 frames compared to 25 frames from Stable Video Diffusion.

“There is a risk of misuse for creating fake or harmful content with our technology, and we believe that it is crucial to develop and apply tools for detecting biases and malicious use cases to ensure a safe and fair use,” said the paper authors.

ALSO READ-Google Cloud AI to power new Samsung phones

Previous Story

Protests Surge in Gilgit-Baltistan Over Inflation

Next Story

Jaishankar congratulates Bhutan’s new Foreign Minister

Latest from Tech Lite

EVs Drive Cleaner Cities

Each EV is equipped with GPS tracking for real-time monitoring and efficiently serves the city’s 159.46 square kilometre area The use of electric vehicles (EVs) in household waste collection is ushering in

India’s Digital Decade Rise

Arundhati Bhattacharya, President and CEO at Salesforce-South Asia and recipient of the Padma Shri, sat down with IANS at an event in the capital to reflect on India’s transformation into a digital

OpenAI Expands In India

This programme, now part of the broader ‘OpenAI Academy’, focuses on real-world impact through hands-on guidance, early access to tools, and shared learning Indians have emerged as the most enthusiastic population globally

Accel Puts India’s AI Power in the Spotlight

Under the theme “Engineering India’s AI Advantage,” the exclusive, invite-only event will bring together leading AI founders, researchers, tech CXOs, policymakers, and global investors….reports Asian Lite News Global venture capital firm Accel

Universities Embrace AI Future

Echoing this sentiment, Professor Esameldin Agamy, Chancellor of UoS, emphasised the value of academic partnerships in nurturing innovation across the UAE’s education sector The American University of Sharjah (AUS) hosted the concluding
Go toTop

Don't Miss

Google AI chatbot Bard now helps people generate, debug code

Bard is still an early experiment, and may sometimes provide

Google Unveils AI Spam Shield for Gmail

RETVec is a novel open-source text vectorizer that allows people