- /IMAGINE
- Posts
- AI Video Race Heats Up! 🎥
AI Video Race Heats Up! 🎥
And → AI Tool Page, Eleven Labs, Pika, tutorial, and more!
Welcome back, my AI-obsessed friends.
Shake off the sleep—it’s Wednesday. This is the latest issue of /Imagine, your go-to source for the freshest news and developments in AI. Here’s EVERYTHING you need to know. Let’s dive in…
🎬 Pika Drops Lip-Sync Magic AI
The Bytes:
✣ Pika Labs announces a new lip-syncing feature as the AI video wars heat up, and it’s all powered by ElevenLabs’ voice generation tech.
✣ This partnership removes a significant barrier to AI-generated narrative films, allowing for seamless dialogue integration. The workflow couldn’t be more simple.
✣ The lip-syncing capability supports both text-to-audio and uploaded audio tracks.
✣ Currently, in early access for Pika Pro users, this feature is a leap forward in AI video production, offering new possibilities for creators.
Why you should care: Pika Labs’ collaboration with ElevenLabs is so well-timed. For storytellers and content creators out there, this means the power to produce high-quality narrative content with AI is now more accessible. This is the worst this will be. In 2024 and beyond, this will usher in a new era of AI-powered filmmaking. Side note: major props to ElevenLabs for all the crazy BizDev they have been up to lately. They are crushing it.
👀 Runway Launches Enhanced Motion Brush Region Detection
📢 NEW: Motion Brush Region Detection in @runwayml
Motion Brush has recieved a QoL update! Now, you can automatically select areas in your image without manually brushing over them!
Share your top Motion Brush videos below! 👇🏼 twitter.com/i/web/status/1…
— Nicolas Neubert (@iamneubert)
9:19 AM • Feb 27, 2024
The Bytes:
✣ Runway introduces Motion Brush Region Detection, enhancing its Gen-2 motion brush feature for AI video generation. This was MUCH needed.
✣ This nifty tool upgrade automatically identifies and applies the motion of your choosing to different regions within an image. Drastically improved over their previous method of having to paint the regions you wanted motion.
✣ This upgrade addresses one of the main challenges in generative AI video tools: getting objects to play nice in a scene and increasing the creator’s control.
Why you should care: Big day for AI video. Runway’s latest feature is a game-changer for video editors and content creators. The ability to automatically detect and animate regions within a video not only saves time but also opens up new creative possibilities. Whether you’re a professional filmmaker or an enthusiast, Runway’s Motion Brush Region Detection is set to revolutionize the way we think about and create AI-generated videos. I’ll work on it and post a tutorial on X soon.
Prompt Share: a well-dressed alien bellhop at an alien resort, hyperrealistic, 8k, cinematic, shot on Hasselblad --chaos 20 --ar 16:9 --style raw --stylize 800
used -- sref here with some Wes Anderson-style color palettes & images
This was then upscaled 4x with Magnific AI.
Check out my Midjourney starter kit for more tips here!
Join Us: Don't forget to follow me on Twitter/X at @jake_joseph and the brand on its fresh new page @slashimagineai. Let’s be friends.
Share The Insights: Know someone else who's obsessed with AI? Forward this newsletter and let's expand the community.
Want to advertise in /Imagine’s Daily Newsletter or on our Tools Page? → Book here!
Want more resources? → Check out our Tools Page!
Feedback
How did we do with today's newsletter?Share your vote to help us deliver the #1 resource on AI for our community. |
Your perspectives help shape the content and hopefully help me make the newsletter suck less every day. Share your feedback on this issue or what you'd like to see next by directly replying to this email or by reacting to the poll above.