inference

Sizing an On-Prem GPU from Weeks of Resident VRAM Data

A spec sheet tells you the card's memory, not what your container actually holds at rest. Here is how weeks of resident VRAM readings sized a single on-prem GPU.