Categories: Apps

Tencent’s New Tool Animates Static Pictures

Building on the excitement of artificial intelligence advancements, the collaboration between Tencent, Tsinghua University, and the Hong Kong University of Science and Technology has yielded an innovative image-to-video tool, “Follow-Your-Click.” This project is now showcased through a detailed and interactive online platform, inviting users to explore the capabilities of transforming static images into dynamic videos with straightforward prompts like “Tune the head,” “Flap the wings,” or even “Storm.”

“Follow-Your-Click” stands out for its open-domain regional image animation, allowing users to animate specific parts of an image through simple commands, leading to outputs such as images smiling, dancing, or undergoing various other transformations. This gallery of animations is not just a testament to the tool’s versatility but also serves as an inspiration for potential users on the endless possibilities it offers.

In a comparative analysis against other leading animation methods and commercial tools like Animate-Anything, SVD, Dynamicrafter, I2VGen-XL, Gen-2, Genmo, and Pika Labs, “Follow-Your-Click” demonstrates its prowess. It provides a nuanced approach to animation, allowing for motion strength control through optical flow motion magnitude (OFM) and frames per second (FPS) based controls, ensuring users can fine-tune their animations to achieve the desired effect.

Moreover, the project delves into an ablation study to assess the impact of its constructed short prompt dataset (D) and motion-augmented module (M) on the quality of animations, particularly focusing on the complexity of generating realistic human motions. While the tool showcases significant potential, it candidly acknowledges its limitations in animating large and complex human movements, attributing this to the intricate nature of such actions and the scarcity of related training samples.

“Follow-Your-Click” not only paves the way for more intuitive and accessible AI-driven animation tools but also sets a benchmark for future developments in this field. Its project page, borrowing the template from DreamBooth, serves as a comprehensive resource for exploring the depth of this innovation, encouraging users and researchers alike to engage with and expand upon its capabilities.

Source: Follow Your Click


Like this article?  Keep up to date with AI news, apps, tools and get tips and tricks on how to improve with AI.  Sign up to our Free AI Newsletter

Also, come check out our free AI training portal and community of business owners, entrepreneurs, executives and creators. Level up your business with AI ! New courses added weekly. 

You can also follow us on X

AI News

Recent Posts

Kling AI from Kuaishou Challenges OpenAI’s Sora

In February 2024, OpenAI introduced Sora, a video-generation model capable of creating one-minute-long, high-definition videos.…

6 months ago

Alibaba’s Qwen2 AI Model Surpasses Meta’s Llama 3

Alibaba Group Holding has unveiled Qwen2, the latest iteration of its open-source AI models, claiming…

6 months ago

Google Expands NotebookLM Globally with New Features

Google has rolled out a major update to its AI-powered research and writing assistant, NotebookLM,…

6 months ago

Stability AI’s New Model Generates Audio from Text

Stability AI, renowned for its revolutionary AI-powered art generator Stable Diffusion, now unveils a game-changing…

6 months ago

ElevenLabs Unveils AI Tool for Generating Sound Effects

ElevenLabs has unveiled its latest innovation: an AI tool capable of generating sound effects, short…

6 months ago

DuckDuckGo Introduces Secure AI Chat Portal

DuckDuckGo has introduced a revolutionary platform enabling users to engage with popular AI chatbots while…

6 months ago