ComfyUI Workflow: Ghibli Style Video Generation

This ComfyUI workflow offers a unique path for creating Ghibli-style video content. It transforms a single input picture into a dreamy Ghibli-style image and then animates that image into a dynamic video. Built with the EasyControl and Wan nodes, this workflow facilitates a seamless transition from static visuals to animated narratives.

What makes this workflow special

• Single image input: Start with just one picture and transform it into a beautiful Ghibli-style image using the EasyControl node.
• Dynamic video output: Convert the generated Ghibli-style pictures into captivating videos through the Wan node.
• Seamless creation: Achieve a complete workflow from a static image to a dynamic video, offering new possibilities for creative expression.

How it works

• Hugging Face token acquisition: Secure an hf_token for accessing necessary models.
• Ghibli image creation: Upload a source image and input a text prompt. Enable the Ghibli feature to generate a Ghibli-style picture. Adjust image resolution (height and width) as needed. An optional load_8bit function can reduce graphics card memory usage, though it may extend image generation time.
• Ghibli video generation: Activate the video feature. Input the previously generated Ghibli-style pictures and a text prompt. Control video resolution using generation_width and generation_height parameters. Customize video length by adjusting frame_rate or num_frames within the WanVideo Empty Embeds node.
• Performance options:
  • WanVideo TeaCache: Accelerates video generation but may reduce video quality.
  • WanVideo Enhance-A-Video: Improves video quality, which can increase video generation time.

Recommended machine

• Ultra-PRO

Workflow details

• App: ComfyUI (v0.3.27)
• Models: 1
• Extensions: 11
• File space: 44 GB