With video generation tools blurring the line between reality and AI, the continuous developments are only making it easier for people to create stunning visuals. RunwayML, an applied AI research company for AI video editing and generation, which is capable of making videos from short text-based prompts, has released a series of new updates and features. The updates are said to enhance user experience by providing more control, fidelity and expressiveness.
Here are some of the spectacular new features of RunwayML that transcends the boundaries of creativity.
Motion Brush
Motion Brush, a cutting-edge interface for generative models, is empowering artists with controlled movement options for enhanced creative expression. This tool addresses the need for increased utility and expressiveness in generative models, providing users with precise control over their creations.
Users can paint an area or subject, and choose appropriate directions and intensity to the motion. Thereby, allowing one to transform any kind of images or portion of images into a video. This has been called a much-needed feature with many sharing their experiments with the new tool. A few users have also tried running this feature on images generated from Midjourney.
RunwayML's new Motion Brush feature is unreal.
It lets you pick exactly where to add movement in your image.
Talk about a game-changer. pic.twitter.com/whyK3sxITO— Bryan Marley (@_bryanmarley) November 27, 2023
Gen 2 Style Presets
The company believes that control is not just about motion but also art direction and style. Style presets in Gen2 allows one to create content using curated styles without the need of complex prompting. Glossy animations, grainy retro film stocks are some of the many styles that can be brought to stories.
🧪 RW Style Preset Experiment: Consistent Prompts@runwayml released style presets for T2V in their latest update. I wanted to explore their impact in different scenarios.
Let's take a cinematic prompt for the first experiment and use it with each preset!
Prompt / Preset 👇🏼 pic.twitter.com/ixnVb8a81y— Nicolas Neubert (@iamneubert) November 23, 2023
Director Mode Updates
The advanced camera control on Dorector’s mode has been updated with more nuances. With this, a more granular level of control can be obtained. Furthermore, a user can fine-tune camera moves using fractional numbers for improved precision.
3) Director Mode Updates
Director Mode’s advanced camera controls have been updated to allow for a more granular level of control. Now you can adjust camera moves using fractional numbers for greater precision and intention. pic.twitter.com/zUbtIrXvFC— Runway (@runwayml) November 20, 2023
New Image Model Update
With the latest update, RunwayML has brought in features to improve fidelity and consistency. The higher resolution generations are now available in options such as text-to-image, image-to-image and image variation. By implementing these features, it also improves storytelling control.
4) New Image Model Update
Improved fidelity, greater consistency and higher resolution generations are now available in Text to Image, Image to Image and Image Variation. Add these tools to your Image to Video workflow for more storytelling control than ever before. pic.twitter.com/3rvvhP8WG5— Runway (@runwayml) November 20, 2023
Combined Motion and Camera Control
To achieve higher precision and control over an image, combining the tools can lead to desired results. Users can fine-tune it as per their desired style with the ‘style preset’ option. This will enable better expressibility too.
Continuing to experiment with @runwayml Motion Brush Beta feature.
Result from my stacked image with ⬆️vertical Motion Brush movement and extended with Camera Motion zoomed in at 1.7 speed.
Original image in the next post: pic.twitter.com/vx7NKzgtHz— Heather Cooper (@HBCoop_) November 20, 2023
Runway has been working aggressively to release updates in the AI image space to compete with other players such as Midjourney and Stable Diffusion, who released a new feature where meme images can be converted to videos.
Runway has also received significant funding. The company raised funds of over $141 million from major tech giants such as Google, Nvidia, Salesforce and others.
Furthermore, Runway AI announced its partnership with Canva, a graphic-design tool company to create generative AI videos and provide Gen-2 AI technology to Canva’s ecosystem.
The post 5 Spectacular New Features of RunwayML appeared first on Analytics India Magazine.
