Skip to content

Conversation

@r4inm4ker
Copy link

@r4inm4ker r4inm4ker commented Dec 23, 2025

What does this PR do?

Adds Differential Diffusion to Z-Image
Mostly copied from pipeline_flux_differential_img2img.py implementation.

Before submitting

How to test:

import torch
from pipeline_z_image_differential_img2img import ZImageDifferentialImg2ImgPipeline
from diffusers.utils import load_image

pipe = ZImageDifferentialImg2ImgPipeline.from_pretrained("Z-a-o/Z-Image-Turbo", torch_dtype=torch.bfloat16)
pipe.to("cuda")

init_image = load_image("https://github.com/exx8/differential-diffusion/blob/main/assets/input.jpg?raw=true")

mask = load_image("https://github.com/exx8/differential-diffusion/blob/main/assets/map.jpg?raw=true")

prompt = "painting of a mountain landscape with a meadow and a forest, meadow background, anime countryside landscape"

image = pipe(
 prompt,
 image=init_image,
 mask_image=mask,
 strength=0.75,
 num_inference_steps=9,
 guidance_scale=0.0,
 generator=torch.Generator("cuda").manual_seed(0),
).images[0]
image.save("image.png")

Who can review?

@yiyixuxu @asomoza

@asomoza
Copy link
Member

asomoza commented Dec 23, 2025

@bot /style

@github-actions
Copy link
Contributor

Style fix is beginning .... View the workflow run here.

@asomoza
Copy link
Member

asomoza commented Dec 23, 2025

@r4inm4ker thanks a lot! the bot can't fix the style, can you please run:

make style
make quality

also if it doesn't fix it, there's some white spaces in some empty lines in the example doc string

@asomoza
Copy link
Member

asomoza commented Dec 23, 2025

in the meantime, this is the apple pear test with this one:

original mask result
20240329211129_4024911930 gradient_mask zimage_diff_diff

this one is more finicky too than SDXL, I had to up the strength to 0.9 and use 12 steps to get that result

@bghira
Copy link
Contributor

bghira commented Dec 23, 2025

need sigma shift

@r4inm4ker
Copy link
Author

Thanks for the feedback ! I will work on the updates after coming back from holiday.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants