In 1962, my then-teenaged father captured a series snapshots that encapsulated the spirit of Mid-Century America —the images of a family road trip out west. I decided to bring them into the modern day using AI animation tools with low expectations. The experiment went about as well as I could expect.

 

In this video, I take you through the journey of animating my father’s 1962 photos using AI tools like Luma Dream Machine (free) and RunwayML Gen-3 (paid). The results are a fascinating mix of the past and future, set to the haunting track ‘Spongebob’ by Billy Woods and Kenny Segal. Watch as vintage moments come to life with AI—complete with unexpected distortions and surreal transformations. See how AI handles different elements like people, vehicles, and buildings, and learn about the strengths and limitations of these powerful tools. #AIAnimation #BillyWoods #RunwayML #VintagePhotos #MusicVideo

I used two different AI tools for this project because that’s what I could afford: the free version of Luma Dream Machine and the paid version of RunwayML Gen-3. While both tools offered unique capabilities, the results were mixed, providing a fascinating learning experience in the world of AI-generated animation.  AI Video is still in the weird hands phase AI photos where a couple years ago.

The Process: Exploring AI Capabilities

Luma Dream Machine (Free Version):
Luma Dream Machine allowed me to create simple animations from static images. However, its limitations were apparent when it came to animating complex subjects like people and vehicles. The AI struggled to maintain the integrity of these shapes, often transforming them in unpredictable ways. This tool worked best with images that had minimal movement or subjects positioned either very close to the camera or at a significant distance.   In the videos, everyone moves at exactly the same speed with unusual fluidity. Another limitation with the free version is you can only make four videos a day and two at a time, however, sometimes the animation would be in the queue for more than 24 hours.

RunwayML Gen-3 (Paid Version):
With the paid version of RunwayML Gen-3, I had access to more advanced features. This tool excelled in maintaining the structure of buildings, making it perfect for the architectural elements in my father’s photos. However, like Luma Dream Machine, it encountered issues with animating people and vehicles, In some cases I preferred the Luma version, such as the tornado shot.  Runway continued to want to zoom in and when it did the tornado funnel and clouds remained frozen.  The AI’s ability to animate these elements without distortion was limited, highlighting the current challenges in AI animation technology.

Creating the Music Video: “Spongebob” by Billy Woods & Kenny Segal

After experimenting with various outputs, I decided to create a music video using the song “Spongebob” by Billy Woods and Kenny Segal. The haunting beats and eclectic style of the track paired perfectly with the surreal, slightly distorted animations generated by the AI.  Not sure my dad would have totally approved of the song but he’d totally would have been down with the animation.

Reflections on AI Animation: The Good, The Bad, and The Potential

Where is the current state of AI in the creative process when it comes to video?  It’s a ways off.  I can only assume Open AI’s Sora is unable to solve these challenges and that’s why it’s unavailable.  AI can breathe new life into old media, a strange nightmare life.  Keeping the movement simple and focusing on elements like buildings that are less likely to be distorted leads to better results. The tools are powerful, but they still have a long way to go in terms of reliably animating complex scenes.

For those looking to try something similar, I recommend starting with simpler, less detailed images and experimenting with different tools to see what works best for your specific project.  Check out some of the original photos below.  I have a photo album from a WWII Admiral I’m dying to test, but waiting until the AI video levels up.

Looking to us AI to level up your skills or business, I’m now consulting with folks like you.  It’s free to chat and I’m a real person.  Visit my consulting page.