24GB is plenty if your engines take turns

Key points

• System service that watches your card, swaps and loads whatever you want, whenever you want.1
• Don’t have to swap anything manually, collisions avoided, VRAM fully dedicated to each function while it’s running (no VRAM squatters).1
• I had issues everyday (Linux) where a node process would orphan, comfyUI auto starts and holds 500MB that strata can’t claim.1
• Berth will also serve your engines as an API so when you need to switch natively you load berth as the API endpoint and you can load strata, polystrata, and any other custom engine.1

Sources (1)

• [1]24GB is plenty if your engines take turns
  r/LocalLLaMA (top, daily) · Oct 20, 03:27 AM

  I also wanted to be able to switch natively and not have to think about starting each engine, making sure strata or llama wasn’t stuck loaded, or flux GGUF’s still claimed in comfyUI from an old workflow.

  System service that watches your card, swaps and loads whatever you want, whenever you want.

Extractive summary: sentences quoted from the sources.