Skip to content

Conversation

@stduhpf
Copy link
Contributor

@stduhpf stduhpf commented Dec 5, 2025

for #1052

sd.exe --diffusion-model ..\ComfyUI\models\unet\LongCat-Image-Q8_0.gguf --vae ..\ComfyUI\models\vae\flux\ae.safetensors --cfg-scale 4.0 --sampling-method euler -v --clip-on-cpu -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night. The city lights are a chaotic blur of neon orange and cool blue, reflecting on the wet asphalt. The scene evokes a sense of being a single component in a vast machine. Superimposed over the image in a sleek, modern, slightly glitched font is the philosophical quote: 'THE CITY IS A CIRCUIT BOARD, AND I AM A LONG CAT.' -- moody, atmospheric, profound, dark academic" --preview proj --steps 20 --qwen2vl ..\ComfyUI\models\clip\Qwen2.5-VL-7B-Instruct.Q4_K_M.gguf --diffusion-fa --color -W 1024 -H 1024

output

Test models can be found there: https://huggingface.co/stduhpf/LongCat-Image-gguf/tree/main

@wbruna
Copy link
Contributor

wbruna commented Dec 5, 2025

That does look a bit like a circuit board...

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 6, 2025

TODO for when image generation works
image

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 6, 2025

I can't figure out what I'm doing wrong, I think it is supposed to be working just like Flux1, but with different PE indices and Qwen Text Encoder.... Maybe I'm missing an important detail but I can't find it.

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 7, 2025

I tried using my SplitAttention thing on a Flux model converted to diffusers format, and
output
I guess I found what is not working. I will try converting LongCat to Flux format and see if it works.

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 8, 2025

I think I got it?
output

With the padding fixed, but with diffusers format:
output

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 8, 2025

With the character-level tokenization trick:
output

Might need testing to make sure the current implementation supports languages that don't use the latin alphabet. Also for now it's applied to text wrapped in single quotes ( ') only.

@stduhpf stduhpf marked this pull request as ready for review December 8, 2025 01:29
@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 8, 2025

Oh no, why are there so many conflicts now?

@stduhpf
Copy link
Contributor Author

stduhpf commented Dec 8, 2025

Using ' as a quote delimiter was a bad idea because it's the same symbol used for apostrophes. I will change it to detect " instead

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants