comfyanonymous 223364743c llama: cast logits as a comfy-weight (#12248) ...

This is using a different layers weight with .to(). Change it to use
the ops caster if the original layer is a comfy weight so that it picks
up dynamic_vram and async_offload functionality in full.

Co-authored-by: Rattus <rattus128@gmail.com>

2026-02-03 11:31:36 -05:00

34 KiB

Raw Blame History

View Raw