I was curious to learn what AI Video Generation could do. I was wondering if you could start with an illustration you create yourself and then bring it to life. In this series I take images form the Shape Character series and upload to Runway AI Video Generator to see what kind of results we get.
Prompt: Have these two characters engage with each other.
Result: Some odd movements, but overall that it was cool to see the illustration come to life.
Prompt: Have the smaller robot dance on the head of the larger one.
Result: Not too bad.
Prompt: Have the trainer in the top hat teaching the spotted dog how to do tricks.
Result: The eyes got a bit wonky, but thought the tail wag looked good and the way it stayed true to the illustration style.
Prompt: Have the bird character flap its wings and take off with the other character going for a ride.
Result: This one had the most life. Interesting embellishment on the wings and the rider became a cyclops. But overall pretty cool.
Prompt: Have the small fish swimming past the large fish.
Result: Enjoying the element of surprise to see what will be created. Since I used the phrase "the small fish" it wasn't specific and add the small school of fish which was interesting. I like the way the fish "wakes up" and then follows the school of fish.
Overall this gave me a taste of what you could do with Runway. Each of these videos is what was generated on the first try. I believe you can take the generated video and re-load it back with another prompt to revise it.
Like I wrote about in the article "Professional Creatives and AI," collaborating with AI is just another creative too that has many possibilities if approached creatively.