Tool Open source

gputaskman

gputaskman is a terminal GPU task manager for Windows, Linux, WSL, and Apple Silicon macOS. It shows device telemetry and per-process GPU memory, GPU activity, engine usage, system-RAM spill or paging estimates, and detected runtimes and model information. On Windows it combines WDDM process and adapter counters with NVIDIA NVML or AMD ADL/SMI data; on Linux it uses NVML, and in WSL it streams Windows host counters and matches them to Linux processes using GPU-context evidence. On macOS it reads IOKit and Metal statistics, where Apple GPUs share memory with the CPU.

View repository Mentioned in 1 video ↓

Overview

The tool's model inspector combines mapped DLLs, command-line arguments, model files, GGUF metadata, compatible runtime logs, and local server APIs to identify candidate models and estimate weights, KV-cache, and other buffer sizes. These classifications and breakdowns are estimates or runtime-reported values rather than GPU-memory inspection, and WSL per-process ownership can be inferred or guessed. It provides an interactive Textual terminal UI, one-shot text and JSON output, snapshot comparison, history charts, and support for local workloads including graphics, video, training, and several LLM runtimes.

The project describes itself as early experimental software. It is distributed under the MIT license, with portable Windows and Linux builds and source-based execution on macOS; Windows releases include native x64 and ARM64 ZIPs and require a supported GPU with a current driver. It does not monitor cloud workloads, dump model weights, or enumerate individual game textures.

What gputaskman is used for

1 use taken from transcripts — each links to the moment in the video.

  • An htop for your GPU from Scott Hanselman that shows what's running on your graphics card in the terminal on Windows with Nvidia cards, including per-program memory use, spillover into RAM, and charts of memory, power, and temperature.

Videos mentioning gputaskman

1 in the library.