load-balancing

Load Balancing a GPU Worker Pool with Redis Keyspace Notifications and Leases

GPUs are expensive and run one heavy job at a time, so round-robin routing stalls behind busy workers. Here is a busy-aware scheduler built from Redis leases and keyspace notifications.