Finally, everyone can create Claymation Style cartoons! 🥳 Just a few months ago, it was almost impossible. Now you can make one in under a day! Here's how:
Less than a week ago, while playing with Runway’s Gen-4 model, I noticed that it can animate not only anime-style images but claymation-style images too. Unlike most img-to-video tools, Gen-4 seems to recognize and adapt to the visual style of the input, producing motion that
1. First, prepare a storyboard template. By arranging static images in the correct order, we can visualize the flow of the story before production begins. This also helps ensure that our shots are consistent in style/characters. I use http://Canva.com whiteboard
2. Then, find a claymation-style image to use as the first shot of your cartoon. I highly recommend using Midjourney’s Explore feature and searching for the term “Claymation” If you already have an image you like but it’s not in clay style, just ask ChatGPT to change it.
3. Come up with different camera angles. For a 15-second cartoon, you’ll need at least 3–4 different shots with various camera angles of the main scene. Right now, there are three options you can use: 1) ChatGPT 2) Runway references 3) Midjourney Omni Reference Most of the
4. Place these images into your storyboard template. As you may have noticed, we have 8 shots but only 4 images. That’s the beauty of creating cartoons, if done right, you can reuse the same shots multiple times without losing the viewer’s attention.
5. If the storyboard looks good, it’s time to animate! Check for any issues, mainly inconsistencies in style, colors, characters, or environment. If everything looks consistent, you’re ready to move on. As I mentioned, Gen-4 model works best for animating clay-style images.
6. Almost done! Only one scene left, and it needs lipsync. Use CapCut Dreamina, Kling, or Hedra , for this one, @hedra_labs worked best. Stitch it all in CapCut and upscale with @DomoAI_!
This is it guys! New style finally unlocked! 🔥 The more I dig into this rabbit hole of AI Cartoons the more cool stuff I discover! If you have any questions about the process or ideas where to dig next leave a comment! Let’s conquer these uncharted waters together! 🏴☠️