Subscribe for new AI tools + updates sent weekly
Subscribe To Newsletter

Lord Of The Rings AI Tutorial

What happens when you blend the epic fantasy of Lord of the Rings with the whimsical, hand-drawn beauty of a Studio Ghibli film… and throw in some cutting-edge AI magic?

You get one of the most visually stunning fan-made trailers on the internet — a reimagining that feels like a long-lost Ghibli masterpiece from an alternate universe.

The creator behind this viral project is PJ Ace, an independent artist who pulled off this jaw-dropping piece of animation using only a few powerful AI tools — no studio, no team, no traditional animation background.

The Process: Step-by-Step Breakdown

Let’s break down exactly how PJ Ace made this masterpiece — and how you can follow the same steps to create something just as magical.

Step 1: Capture the Source Frames

First, PJ Ace captured every single frame of the original Lord of the Rings trailer he wanted to reimagine. This wasn't just a quick screengrab or two — he meticulously went through the trailer and took 102 individual screenshots, one for each key scene.

The goal here was to create a visual storyboard — a frame-by-frame guide that would later be transformed using AI.

Tip: You can use tools like VLC Media Player to step through videos frame by frame and take high-resolution screenshots.

Step 2: Reimagine Each Frame with ChatGPT’s Image Model

With all 102 images ready, PJ turned to the new image capabilities inside ChatGPT (using GPT-4 with image functionality) to begin transforming them.

He uploaded each screenshot into ChatGPT and used a custom prompt like:

“Recreate this in the style of Studio Ghibli. Intricately detailed. Keep the same color, and vibe.”

The result? Each frame was rendered in a stunning hand-drawn Ghibli-esque style, preserving the emotion and composition of the original scene while adding that unmistakable Miyazaki magic.

Tool: You’ll need ChatGPT Pro to access GPT-4o with image input. Learn more here.

Step 3: Animate the Still Images with Kling & Luma AI

Once every frame had been stylized, PJ used two advanced AI tools to animate them:

  • Kling AI – A motion-generation model that animates still images using only a text prompt.
  • Luma AI – A 3D generation and video tool that adds smooth, cinematic motion and depth.

With prompts like:

“A man yells, looking fearful”
“A woman talks, looking concerned”

PJ was able to bring each frame to life. The movement was subtle and emotional — breathing life into what were once static images.

Extra Tip: Making the Lips Move with AI

If you want to take your animated scenes even further — especially to create the illusion of characters actually talking — you’ll want to animate the lips. This adds a whole new level of realism and immersion.

One of the best tools for this is Runway ML, specifically their Gen-2 or Lip Sync models. Here's how to do it:

  1. Export the face portion of your character or video frame as a short clip or still image.
  2. Record your dialogue as an audio file — you can use AI voice generators like ElevenLabs or Play.ht.
  3. Upload both the image/video and the voice clip into Runway ML's Lip Sync tool.
  4. The AI will automatically sync the mouth movements to match the speech in your audio file, creating a realistic talking animation.

You can then layer this lip-synced footage back into your animated scene using your video editor. Combine it with subtle eye blinks or head movements for even more believability.

Note: For best results, keep the face centered and clearly visible in your source frame. The more detail and clarity, the better the lip-sync will look.

Step 4: Editing & Final Assembly

With all 102 frames now stylized and animated, PJ imported everything into a video editor (like DaVinci Resolve or Adobe Premiere Pro) and synchronized them with the original trailer's pacing and audio.

Timing, transitions, music, and sound effects are what gave this AI experiment true cinematic impact.

Pro Tip: Use AI voice tools or royalty-free voiceover sites to add narration or dialogue. Try Play.ht or ElevenLabs.

Why This Matters: The Future of Solo Filmmaking

This project isn’t just cool — it’s a sign of what’s possible when creativity meets AI.

A single creator was able to reinterpret one of the most beloved fantasy franchises of all time in a totally new style, using tools that are now available to anyone with a laptop and an idea.

You don’t need a team of animators. You don’t need a $50k budget. You need vision, a few key tools, and a willingness to experiment.

Whether you’re an artist, filmmaker, marketer, or just someone who loves storytelling — the barrier to entry has never been lower. And the quality you can produce has never been higher.

Links to All Tools Mentioned

Final Thoughts

The line between dream and reality is getting blurrier every day — and with AI, the only limit is your imagination.

If you’ve ever wanted to make a short film, reimagine your favorite story, or just experiment with new creative tools, now is the perfect time to start.

Don’t just be a fan — become a creator!

FREE "ChatGPT Cheat Codes" Course
(Get Ahead While Everyone Else Stays Stuck)
Made With ♥️ By Dan Scalco | Copyright 2025 | Sitemap
Subscribe To Stay On Top Of AI Trends
Your friends will start asking... "how do you know so much about AI?"
Sign in to Save & Like AI Tools
Create your free account and stay on top of new AIs.
By signing in, you agree to our Terms of Use and Privacy Policy.
Sign Up to Save & Like AI Tools
Create your free account and stay on top of new AIs.
By signing up, you agree to our Terms of Use and Privacy Policy.
It's Better With AI magnifiercross