🏠Home
Wiki
Pages
Latest activity
Forums
Announcements
Media
New media
New comments
Search media
FusionFall Game Archive
FusionFall Archive
Join Discord to Download FusionFall
Log in
Register
What's new
Search
Search
Search titles only
By:
Pages
Latest activity
Menu
Log in
Register
Navigation
More options
Close Menu
Wiki
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Edit history
<div style="color:#e0e0e0; background-color:#0e0e0e; font-family:Segoe UI, sans-serif; padding:1em; line-height:1.7; font-size:17px;"> <!-- Flexbox heading + logo --> <div style="display:flex; align-items:center; justify-content:space-between; flex-wrap:wrap;"> <p style="margin:0; font-size:22px; color:#ff4081;"><strong>House of Roiland Wiki</strong></p> <a href="http://fusionfall.org/wikim/stepz/horlogo.jpg" target="_blank" style="margin-top:5px;"> <img src="http://fusionfall.org/wikim/stepz/horlogo.jpg" alt="House of Roiland Logo" style="width:40px; opacity:0.85;" /> </a> </div> <div style="margin-top:0.8em;"> House of Roiland is a mini-series I’m working on about disgraced animator Justin Roiland trying to take back <em>Rick and Morty</em> from the evil executives at Adult Swim. </div> <div style="margin:0.5em 0;"></div> <h3 style="color:#ff4081;"><strong>Workflow Overview</strong></h3> <div>Our goal is to generate a clean reference image (using a tool like ChatGPT or Sora), then animate it through a video generator such as Runway. Runway produces a sequence of frames where subtle movements occur. The stars twinkle, the moon glows, and the grass sways. We dump those frames with a Python script, hand draw over the first frame, then use Leonardo to create a flat, bold color backing beneath our linework. Next, we draw over the second Runway frame, repeating the process. This creates a double movement effect: the simulated animation from Runway plus the human drawn variation frame to frame.</div> <div style="margin:0.5em 0;"></div> <h3 style="color:#ff4081;"><strong>Creative Motivation Process</strong></h3> <div>My creative process often begins by collecting varied sparks of inspiration, whether they come from things I see online, new tools at my disposal, or wild ideas scribbled in a journal. I use these notes to fuel my imagination and drive my work forward. In this case, three distinct inspirations stood out:</div> <ul style="padding-left:1.5em; list-style: disc;"> <li><p><strong>VRChat Rapper Avatar:</strong> A girl in VRChat who raps, brandishes a toy gun, points it at the camera, and shares punchy Instagram reels. Her bold attitude and performance style highlighted the power of character-driven energy.</p></li> <li><p><strong>Messy Hand Drawn Animations:</strong> A creator making short, color-accented animations with intentionally rough, expressive linework, reminding me that imperfection can be its own aesthetic.</p></li> <li><p><strong>Access to Google VEO:</strong> Having Google VEO at my fingertips opened possibilities for new techniques and tools, expanding what I can experiment with next.</p></li> </ul> <div style="margin:0.5em 0;"></div> <h3 style="color:#ff4081;"><strong>Background Introduction</strong></h3> <p>House of Roiland needs a background/location for its introduction, so I went on Pinterest looking for inspiration and found an image of Misty holding a crucifix to ward off ghastly against a vibrant night sky and green grass.</p> <div style="text-align:center; margin:1.5em 0;"> <img src="http://fusionfall.org/wikim/stepz/mistyref.jpg" alt="Misty holding crucifix reference" style="max-width:100%; border:2px solid #ff4081; border-radius:8px;" /> <p style="color:#aaa; font-size:14px;">↑ Misty reference image</p> </div> <p>I searched Pinterest for more images with blue starry skies and grass. I found five other images and sent them all to ChatGPT alongside this prompt:</p> <blockquote style="border-left: 3px solid #ff4081; padding-left: 1em; font-style:italic; color:#ccc;"> turn these reference images into a line drawn piece of digital art like you'd make in adobe flash CS6 it should be color blocked with a fantastically drawn blue starry sky and a grassy foreground for my character to stand on it should have linework akin to a disney artist and be a very simple scene with sharp messy lines and simple ms paint type color blocking </blockquote> <p>But it just hallucinated a new picture of Misty:</p> <div style="text-align:center; margin:1.5em 0;"> <img src="http://fusionfall.org/wikim/stepz/mistyaccident.png" alt="Hallucinated Misty image" style="width:300px; max-width:100%; border:2px solid #ff4081; border-radius:8px;" /> <p style="color:#aaa; font-size:14px;">↑ Hallucinated Misty image returned by ChatGPT</p> </div> <p>So I used Sora with this prompt:</p> <blockquote style="border-left: 3px solid #ff4081; padding-left: 1em; font-style:italic; color:#ccc;"> turn these reference images into a line drawn piece of digital art like you'd make in adobe flash CS6 it should be color blocked with a fantastically drawn blue starry sky and a grassy foreground for my character to stand on it should have linework akin to a disney artist and be a very simple scene with sharp messy lines and simple ms paint type color blocking. incorporate details from all 6 reference images but there should be no characters just the sky and the grass and the earth </blockquote> <p>Once it made a suitable reference image:</p> <div style="text-align:center; margin:1.5em 0;"> <img src="http://fusionfall.org/wikim/stepz/firstbackgroundref.png" alt="First suitable background reference" style="max-width:100%; border:2px solid #ff4081; border-radius:8px;" /> <p style="color:#aaa; font-size:14px;">↑ Background reference generated by Sora</p> </div> <p>We put the image into Runway and it cropped it to 16:9 (1280×720), then I had Runway make a reference animation using the prompt below:</p> <blockquote style="border-left: 3px solid #ff4081; padding-left: 1em; font-style:italic; color:#ccc;"> Animate this scene using only the existing elements. Make the existing stars softly twinkle in place by subtly fluctuating their brightness. Add a slow, gentle glow pulse to the existing crescent moon without moving it. Slightly sway the existing grass, flowers, and tree branches back and forth, as if moved by a soft breeze, keeping their original shapes and positions. The tree trunk and moon remain completely still. Do not add or generate any new elements, shapes, or lights. Keep the motion smooth, slow, and calming to create a peaceful nighttime atmosphere. </blockquote> <p>Runway created a decent example I decided to go with:</p> <div style="margin:1.5em 0; text-align:center;"> <video controls style="max-width:100%; border:2px solid #ff4081; border-radius:8px;"> <source src="http://fusionfall.org/wikim/stepz/runwaytestanimation.mp4" type="video/mp4" /> Your browser does not support the video tag. </video> </div> <p>I then dumped frames for this animation with a Python script: <a href="https://fusionfall.org/wikim/dumpframes.py" style="color:#88c0ff;">dumpframes.py</a></p> <p>Next, I got into Adobe Flash and hand draw over the first frame with the Paint Brush tool and my Wacom drawing tablet.</p> <p>Once I finished hand drawing the background, we exported it with a transparent background from Adobe Flash as <code>foreground.png</code> (4000×2250 / 1280×720):</p> <div style="text-align:center; margin:1.5em 0;"> <div style="background-color:#ffffff; display:inline-block; padding:0.5em; border-radius:8px;"> <img src="http://fusionfall.org/wikim/foregroundtransparent.png" alt="Foreground hand drawn background" style="max-width:100%; border:2px solid #ff4081; border-radius:8px; display:block;" /> </div> <p style="color:#aaa; font-size:14px;">↑ Exported foreground with a transparent background</p> </div> <p>I added a white background in Befunky (or similar design programs) and resized it to 1392×752 (16:9 in Leonardo):</p> <div style="text-align:center; margin:1.5em 0;"> <img src="http://fusionfall.org/wikim/whitebackgroundd.png" alt="Resized background with white backdrop" style="max-width:100%; border:2px solid #ff4081; border-radius:8px;" /> <p style="color:#aaa; font-size:14px;">↑ Resized background with white backdrop</p> </div> <p>Then I sent it to Leonardo (Kontext model) with the prompt:</p> <blockquote style="border-left: 3px solid #ff4081; padding-left: 1em; font-style:italic; color:#ccc;"> Please colorize this line drawing in a flat, bold, cartoon-like style. Make the sky a deep navy blue with scattered white stars and larger twinkling star shapes. Add a bright crescent moon in the upper right sky. Color the tree a dark blue-green. The hills should be dark blue shades to suggest night. Fill the foreground with a field of purple and blue flowers, and a few red flowers, with dark green foliage. Make the path a warm brown color. Overall, match the style and colors of a peaceful, whimsical night landscape. </blockquote> <p>Leonardo (Kontext model) gave me a new colorized image that we put underneath the hand drawn line work. The results are:</p> <div style="text-align:center; margin:1.5em 0;"> <img src="http://fusionfall.org/wikim/autocolored.png" alt="Final composited background" style="max-width:100%; border:2px solid #ff4081; border-radius:8px;" /> <p style="color:#aaa; font-size:14px;">↑ Final composited background with colorization</p></div>
Revert
Wiki
Top