OpenAI
Gpt Oss 120B
Gpt Oss 120B is an open-weights 120B-parameter model by OpenAI. It holds an Intelligence score of 55.5 on the local.ai leaderboard (2026-08 snapshot).
open weights
55.5
local.ai Intelligence
Parameters
120B
Benchmarks (local.ai snapshot)
HuggingFace metadata · updated 2025-08-26
Metadata refreshed from the HuggingFace API (snapshot 2026-08-15T15:53:42.405Z). Context length and long-form descriptions are the next pipeline stage.
Does it fit your hardware?
Detect or select your GPU first. Green = weights + context headroom, yellow = tight, grey = does not fit.
Q4_K_M 69.6GQ6_K 108GQ8_0 132GFP16 240G| Quantization | ≈ File size | Note |
|---|---|---|
| IQ2_XXS | 32.4 GB | Extreme compression, largest quality loss |
| IQ3_XXS | 43.2 GB | Very small |
| Q3_K_M | 55.2 GB | Small |
| NVFP4 | 60 GB | NVIDIA 4-bit |
| Q4_K_S | 64.8 GB | Common |
| Q4_K_M | 69.6 GB | Most common sweet spot |
| Q5_K_M | 91.2 GB | Balanced |
| Q6_K | 108 GB | Near-lossless |
| Q8_0 | 132 GB | Near-lossless |
| FP16 | 240 GB | Original weights |
Actual files on HuggingFace
| File | Size |
|---|---|
| metal/model.bin | 60.76 GB |
| original/model--00001-of-00007.safetensors | 9.82 GB |
| original/model--00003-of-00007.safetensors | 9.77 GB |
| original/model--00002-of-00007.safetensors | 9.77 GB |
| original/model--00005-of-00007.safetensors | 9.77 GB |
| original/model--00004-of-00007.safetensors | 9.77 GB |
GGUF: unsloth/gpt-oss-120b-GGUF · 108,720 downloads
| File | Size | |
|---|---|---|
| Q2_K/gpt-oss-120b-Q2_K-00001-of-00002.gguf | 46.06 GB | download |
| Q2_K/gpt-oss-120b-Q2_K-00002-of-00002.gguf | 12.21 GB | download |
| Q2_K_L/gpt-oss-120b-Q2_K_L-00001-of-00002.gguf | 46.33 GB | download |
| Q2_K_L/gpt-oss-120b-Q2_K_L-00002-of-00002.gguf | 12.21 GB | download |
| Q3_K_M/gpt-oss-120b-Q3_K_M-00001-of-00002.gguf | 46.10 GB | download |
| Q3_K_M/gpt-oss-120b-Q3_K_M-00002-of-00002.gguf | 12.22 GB | download |
| Q3_K_S/gpt-oss-120b-Q3_K_S-00001-of-00002.gguf | 46.06 GB | download |
| Q3_K_S/gpt-oss-120b-Q3_K_S-00002-of-00002.gguf | 12.21 GB | download |
| Q4_0/gpt-oss-120b-Q4_0-00001-of-00002.gguf | 46.10 GB | download |
| Q4_0/gpt-oss-120b-Q4_0-00002-of-00002.gguf | 12.22 GB | download |
| Q4_1/gpt-oss-120b-Q4_1-00001-of-00002.gguf | 46.18 GB | download |
| Q4_1/gpt-oss-120b-Q4_1-00002-of-00002.gguf | 12.23 GB | download |
What you save self-hosting this model
Uses the model's own API price when it exists; otherwise the closest commercial equivalent.
Waiting for hardware detection…
Related models
RunLocal presents third-party leaderboard data (local.ai / Exo Labs, 2026-08) with its own fit and cost estimates. Verify pricing, licenses and file sizes at the source before deploying a model.