GPU Watchdog

reading device…

live

▲

—

Resident in VRAM

nothing loaded

Recent model swaps

none

Temperature

—°C

slowdown — · shutdown —

Utilisation

—%

SM clock —

VRAM

—MiB

of — MiB

Power

—W

no model resident

Thermal & loadlast 30 min · live

temp °C util % throttled

App	Reqs	Out tok	Avg	p95	tok/s	GPU s

Model	Reqs	Out tok	tok/s	Cold starts

When	App	Model	Endpoint	Duration	In	Out	tok/s	Temp

waiting for the first request through the proxy…