Best local models for
RTX 5080

Every curated model on this card

Context length: 8K tokens · f16 (default)

All memory figures are estimates: measured quantized file size + computed context memory + runtime overhead, with a 12% safety margin on your hardware. Real usage varies with runtime version and settings.

GGUF is the quantized single-file format local runtimes load (Ollama, LM Studio, llama.cpp); our memory figures are measured from the linked GGUF file. The original repo holds full-precision safetensors — a much larger download meant for GPUs with far more memory.