DiffHub Logo
HomeWorkflowsGlossaryGuidesComparison
DiffHub Logo
DiffHub Logo

Master ComfyUI and diffusion models with comprehensive education and community support.

Resources

  • Glossary
  • Service Comparison
  • Blog
  • Contact
  • About

Stay Updated

Get the latest tutorials, tips, and news delivered to your inbox.

No spam, unsubscribe at any time.

This site contains affiliate links. We may earn a commission from purchases made through these links at no additional cost to you.

© 2025 DiffHub. All rights reserved.
Privacy PolicyTerms of ServiceSupport
Guides
Create HYPERREALISTIC Consistent AI Characters - FREE & LOCAL!
Back to Guides
Beginner
Easy

Create HYPERREALISTIC Consistent AI Characters - FREE & LOCAL!

Create HYPERREALISTIC Consistent AI Characters - FREE & LOCAL!...

15 min
AI-Generated
Video Guide

Create Hyperrealistic Consistent AI Characters with ComfyUI

This guide will show you how to create hyperrealistic, consistent AI characters using the Gwen image edit workflow in ComfyUI. You'll learn how to generate datasets, upscale images, and train your own LoRA models for maximum quality and character consistency.

What You'll Learn

By the end of this guide, you'll have:

  • Generated a character dataset from a single input image.
  • Upscaled images with detailed captions.
  • Trained a LoRA model for consistent character generation.

Prerequisites

Before starting, ensure you have:

  • ComfyUI installed. If not, follow the ComfyUI Installation Guide.
  • A suitable GPU for AI model training (RunPod is recommended for resource-intensive tasks).
  • Basic familiarity with ComfyUI interface and custom nodes.

Step-by-Step Process

Step 1: Install ComfyUI and Download Workflow

1
Install ComfyUI and Load Workflow

First, ensure you have ComfyUI installed. Then, download the workflow file and load it into ComfyUI.

  1. Install ComfyUI: If you haven't already, follow the steps in the ComfyUI Installation Guide.
  2. Download Workflow: Download the workflow file from the link in the video description.
  3. Load Workflow: Drag and drop the downloaded workflow file into the ComfyUI interface.

Step 2: Install Custom Nodes

2
Install Missing Custom Nodes

Install the custom nodes required for the workflow to function correctly.

  1. Open ComfyUI Manager: Go to the ComfyUI Manager within the ComfyUI interface.
  2. Install Missing Nodes: Click on "Install Missing Custom Nodes".
  3. Select and Install: Select all the missing nodes and click "Install".
  4. Restart ComfyUI: Restart ComfyUI to ensure the installed nodes are loaded.

Step 3: Download Required Models

3
Download and Place Models

Download the necessary models and place them in the correct directories within your ComfyUI installation.

  1. Identify Models: Check the yellow boxes in the workflow for the required models and their download links.
  2. Download Models: Download each model from the provided links.
  3. Place Models: Place the downloaded models in the specified directories within your ComfyUI folder (e.g., ComfyUI/models/). For GGUF models, you may need to create a subdirectory (e.g., ComfyUI/models/unet/GGUF).
  4. Reload ComfyUI: After placing the models, press "R" to reload the ComfyUI window and refresh the model list.
  5. Select Models: Select the correct models in the corresponding nodes within the workflow.
GGUF Versions

GGUF is a way to compress model sizes, potentially sacrificing some quality. Choose a version that fits comfortably within your GPU's VRAM.

Step 4: Install Ultrasharp Model

4
Install Ultrasharp

Install the Ultrasharp model using the ComfyUI Manager.

  1. Open ComfyUI Manager: Go to the ComfyUI Manager.
  2. Open Model Manager: Click on "Model Manager".
  3. Search for Ultrasharp: Search for "Ultrasharp".
  4. Install: Click "Install" next to the Ultrasharp model.
  5. Refresh ComfyUI: Refresh ComfyUI after installation.

Step 5: Input Image and Configure Workflow

5
Set Up Input Image and Prompts

Input your reference image and configure the prompts for character generation.

  1. Input Image: Drag and drop your reference image into the "Input Image" node. This can be an image in any style.
  2. Character Prompt: Create a prompt describing the character's style. The default is "make an image in this style of the character."
  3. Character Name: Give your character a unique name. This will be used as the trigger word for LoRA training and the output folder name.

Step 6: Generate Character Variations

6
Generate Images and Views

Generate different views, emotions, and poses of your character.

  1. Run Workflow: Click "Run" to start the image generation process.
  2. Clothing Details: Add clothing details to the character prompt to guide the model (e.g., "wearing chunky sneakers").
  3. Modify Prompts: Adjust the prompts for different views and emotions as needed.
  4. Modular Groups: Copy and modify existing groups to generate additional images with different prompts.
  5. Emotion Control: Use the slider to adjust the character's emotions.
  6. Virtual Try-On: Drag and drop a clothing item onto the "Virtual Try-On" group and adjust the prompt to dress the character.
  7. Pose Transfer: Load a reference image with a specific pose into the "Pose Transfer" group to apply the pose to your character.

Step 7: Dataset Creation

7
Create Dataset and Upscale Images

Create a dataset with detailed captions and upscale the generated images.

  1. Isolate Images: If you only want to use specific images for your dataset, change the character name in the workflow and run it again. This will create a new folder with only the currently displayed images.
  2. Run Dataset Creation: Click the "Data Set Creation" button in the workflow.
  3. Add Prompt: Add a prompt to the "Prompt" node in the dataset creation group.
  4. Run Workflow: Click "Run".
  5. Adjust Upscaling: If the character changes too much during upscaling, increase the "Start Step". If you want to add more detail, lower the "Start Step".

Step 8: LoRA Training (RunPod)

8
Train LoRA on RunPod

Train a LoRA model using AI Toolkit on RunPod for improved character consistency and realism.

  1. Create RunPod Account: Create an account on RunPod and add funds to your billing.
  2. Deploy AI Toolkit Pod: Go to "Pod Templates" and search for "AI Toolkit" by ostress and click "Deploy Pod".
  3. Select GPU: Select a suitable GPU (e.g., RTX 3090, RTX 4090).
  4. Change Template: Click "Change Template", then "Edit", and set a password in the "Environment Variables".
  5. Deploy on Demand: Click "Deploy on Demand".
  6. Access AI Toolkit: Once deployed, click on "HTTP Service" to launch AI Toolkit and enter your password.
  7. Create Dataset: In AI Toolkit, go to "Data Sets" and click "New Data Set". Give it a name and drag and drop your images. Remove any unwanted images.
  8. Create Job: Click on "New Job". Name the LoRA, choose the model (one 2.1 is recommended for compatibility), set the save interval (e.g., 500 steps), and select your dataset.
  9. Configure Samples: Set the sample creation interval to match the save interval and adjust the example prompts to fit your character.
  10. Start Training: Click "Create Job" and then the "Start" button to begin training.
  11. Download LoRA: After training, download the LoRA models from the overview page.
  12. Stop Pod: Stop the RunPod to avoid further charges.
Resource Intensive

Training a one LoRA is resource-intensive. Consider using RunPod for faster training, especially with limited VRAM.

Step 9: Generate Images with LoRA

9
Generate Images with Trained LoRA

Use your trained LoRA model to generate images of your character.

  1. Download Workflow: Download the image generation workflow.
  2. Install Missing Nodes: Install any missing custom nodes.
  3. Download Models: Download the required models, including Lenovo Ultra Real and Insta Real 2.2 LoRAs.
  4. Load LoRA: Load your trained character LoRA in both the high noise and low noise model sections of the workflow.
  5. Create Prompt: Create a detailed prompt including your character's trigger word, descriptions, and the trigger words for the other LoRAs (e.g., "insta reel", "Lenovo").
  6. Adjust Post-Processing: Adjust the post-processing effects (chromatic aberration, sharpening, bloom, grain) to your liking.
  7. Generate Images: Click "Generate" to create images. Experiment with different seeds to get variations.

Step 10: Speed Up Image Generation (Optional)

10
Use Light x Lauras for Faster Generation

Use Light x Lauras to significantly reduce image generation time.

  1. Download Light x Laura: Download the Light x Laura.
  2. Load Light x Laura: Load the Light x Laura in both the high noise and low noise model sections.
  3. Adjust Sampler Settings: Set the maximum steps to 8, CFG to 1, and start at step to 3 in both samplers.
  4. Activate Bypass: Activate the bypass using Ctrl+B.

Step 11: Video Generation

11
Generate Videos

Generate videos of your character using the one 2.2 model.

  1. Increase Length: Increase the length of the generation to create a video (e.g., 41 frames).
  2. Add Video Combine Node: Add a "Video Combine" node to save the output as a video.
  3. Rewrite Prompt: Ask a large language model to rewrite the prompt to be suitable for video generation.
  4. Run Workflow: Run the workflow to generate the video.

Related Guides

  • ComfyUI Installation Guide - Complete installation process for ComfyUI
  • Running ComfyUI on RunPod - Run ComfyUI on cloud GPUs instead of local hardware
  • Deploy Your First RunPod - Basic RunPod account setup

Next Steps

Now that you've created consistent AI characters:

  • Experiment with different styles and poses.
  • Explore advanced workflows for higher quality results.
  • Share your creations and tag the creator.

Watch the original video for visual context: Create HYPERREALISTIC Consistent AI Characters - FREE & LOCAL!

AI-Generated Content

This guide was automatically generated using AI (Google Gemini 2.0 Flash via OpenRouter) based strictly on the video transcript. All information comes directly from the video content. For visual demonstrations and additional context, watch the original video.

Generated on 10/17/2025 • Original video: Watch on YouTube

Related Guides

Beginner
Easy
Running ComfyUI on RunPod Cloud GPU
Deploy ComfyUI on RunPod's cloud infrastructure for powerful AI image generation without local hardware requirements.
20 min
Read Guide