From 92fbd1708de1f43606d1b8dcc6a2aca42e73dc76 Mon Sep 17 00:00:00 2001 From: luix93 <76565668+luix93@users.noreply.github.com> Date: Thu, 26 Mar 2026 14:37:02 +0100 Subject: [PATCH] Clarify dynamic VRAM and COMFYUI_FLAGS in README Updated README to clarify dynamic VRAM usage and flags. --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index 3a39a17..6644a88 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,7 @@ Built specifically to handle the quirks of the **sm_121 / compute 12.1** archite - **Comfy Kitchen** (`comfy_kitchen`) — NVFP4 quantization support for Blackwell - **Unified-memory optimized flags** — carefully tuned `COMFYUI_FLAGS` that avoid fighting the Grace-Blackwell memory fabric - **Double-VRAM bug fix** — patches `comfy/utils.py` to set `copy=False` in `tensor.to()`, fixing the double memory usage on unified memory systems with `--disable-mmap` +- **Disabled dynamic vram** — uses `--disable-dynamic-vram` as it doesn't work properly on the Spark, if models fit in memory they won't be unloaded, faster prompt changes to final image/video - **ComfyUI-Manager** — auto-installed at container startup into the mounted `custom_nodes` volume - **ComfyUIMini** — lightweight mobile/tablet UI proxying to the ComfyUI backend (optional second service) - **Health checks** — both services expose health check endpoints for reliable `depends_on` startup ordering @@ -97,6 +98,9 @@ The default `COMFYUI_FLAGS` are tuned for the Grace-Blackwell unified memory arc | Flag | Reason | |---|---| +| `--normalvram` | Enforces normal vram mode | +| `--disable-dynamic-vram` | Disables dynamic vram, keeps models in memory as long as they fit, faster prompt changes to final output | +| `--reserve-vram 1` | Reserves 1gb of vram to the system, i found it works a bit better with the other flags | | `--disable-pinned-memory` | Reduces overhead on the unified memory fabric; pinned memory is counterproductive here | | `--use-sage-attention` | Enables SageAttention compiled for sm_121 | | `--force-fp16` | Enables Flash Attention path in PyTorch |