rattus 4086acf3c2 Fix on-load VRAM OOM (#11144) ...

slow down the CPU on model load to not run ahead. This fixes a VRAM on
flux 2 load.

I went to try and debug this with the memory trace pickles, which needs
--disable-cuda-malloc which made the bug go away. So I tried this
synchronize and it worked.

The has some very complex interactions with the cuda malloc async and
I dont have solid theory on this one yet.

Still debugging but this gets us over the OOM for the moment.

2025-12-06 18:42:09 -05:00

57 KiB

Raw Blame History

View Raw