Models you can run yourself
A model, every quantisation somebody made of it, and what each one costs to run.
Only one source knows: GGUF quantisations 2276 · Hugging Face models 62
Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
| Property | Hugging Face models | GGUF quantisations |
|---|---|---|
| Licence | cardData.license | cardData.license |
Everything else the sources say is shown side by side, and not compared.
Things
26–50 of 486| Thing | Kind | Licence | Downloads | Date |
|---|---|---|---|---|
| Blackfrost-AI/Qwen3.8-27B-ABLITERATED-GGUF Blackfrost-AI/Qwen3.8-27B-ABLITERATED-GGUF · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 113827 / 52 / 73959 | 2026-08-14 |
| facebook/vjepa2-vitg-fpc64-256 facebook/vjepa2-vitg-fpc64-256 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 105290 / 113699 / 146 | 2025-04-07 |
| BoldingBuilds/Ternary-Bonsai-2-27B-Abliterated-PTQ1_0-GGUF BoldingBuilds/Ternary-Bonsai-2-27B-Abliterated-PTQ1_0-GGUF · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 3776 / 50048 / 69655 | 2026-09-18 |
| allenai/Molmo2-8B allenai/Molmo2-8B · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 412 / 62986 / 68863 | 2025-12-14 |
| allenai/OLMo-2-0425-1B-Instruct allenai/OLMo-2-0425-1B-Instruct · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 50 / 61631 / 65395 | 2025-04-29 |
| allenai/Molmo2-4B allenai/Molmo2-4B · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | apache-2.0 | 117 / 58102 | 2025-12-14 |
| canopylabs/orpheus-3b-0.1-ft canopylabs/orpheus-3b-0.1-ft · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 29851 / 51035 / 95 | 2025-03-17 |
| CohereLabs/cohere-transcribe-arabic-07-2026 CohereLabs/cohere-transcribe-arabic-07-2026 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 219 / 48313 / 48407 | 2026-06-18 |
| amd/Qwen3.8-27B-Quark-AWQ-MXFP4 amd/Qwen3.8-27B-Quark-AWQ-MXFP4 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 39074 / 43976 / 7019 | 2026-08-15 |
| EleutherAI/pythia-14m-deduped EleutherAI/pythia-14m-deduped · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 30212 / 31711 / 680 | 2023-07-19 |
| DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU · Hugging Face models, GGUF quantisations | model 2 quantisation 50 | apache-2.0 / cc-by-4.0 / other | 0 / 1015 / 1016 / 10199 / 1088 / 12341 / 12717 / 1379 / 14563 / 1476 / 1511 / 1557 / 1559 / 15592 / 1563 / 1634 / 1683597 / 1719 / 172 / 1724 / 1742 / 1754 / 1787 / 1790 / 17942 / 1840 / 1894 / 1910 / 2027 / 218 / 2217 / 2268 / 2311 / 2572 / 2638 / 29374 / 3160 / 31661 / 3255 / 3367 / 3375 / 3470 / 3592 / 4756 / 506 / 53 / 5401 / 5748 / 6578 / 703 / 904 / 910 | 2026-08-25 |
| DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 27674 / 31101 / 464 | 2025-11-17 |
| BSC-LT/salamandra-7b-instruct BSC-LT/salamandra-7b-instruct · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | apache-2.0 | 110 / 28887 | 2024-09-30 |
| BlinkDL/rwkv7-g1 BlinkDL/rwkv7-g1 · Hugging Face models, GGUF quantisations | model 2 quantisation 8 | apache-2.0 | 138 / 148 / 17001 / 208 / 25127 / 2719 / 3071 / 310 / 378 / 380 | 2025-03-07 |
| fastino/GLiNER2.5-Decide fastino/GLiNER2.5-Decide · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | apache-2.0 | 210 / 24250 | 2026-09-23 |
| ByteDance/Ouro-1.4B ByteDance/Ouro-1.4B · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 102 / 22083 / 23979 | 2025-10-28 |
| allenai/olmOCR-7B-0825-FP8 allenai/olmOCR-7B-0825-FP8 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 18250 / 20456 / 235 | 2025-08-13 |
| Edge0/Audio8-ASR-Infinite Edge0/Audio8-ASR-Infinite · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 19963 / 52 / 7859 | 2026-09-21 |
| abacusai/Smaug-Mini abacusai/Smaug-Mini · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 17917 / 18084 / 503 | 2026-09-02 |
| allenai/Molmo2-O-7B allenai/Molmo2-O-7B · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | apache-2.0 | 0 / 17194 | 2025-12-14 |
| allenai/Olmo-3.1-32B-Instruct allenai/Olmo-3.1-32B-Instruct · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 141 / 16094 / 16665 | 2025-12-10 |
| baidu/ERNIE-4.5-0.3B-PT baidu/ERNIE-4.5-0.3B-PT · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 15522 / 15526 / 161 | 2025-06-28 |
| ByteDance/Ouro-1.4B-Thinking ByteDance/Ouro-1.4B-Thinking · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 129 / 13016 / 14979 | 2025-10-28 |
| empero-ai/Qwen3.8-9B-Distill empero-ai/Qwen3.8-9B-Distill · Hugging Face models, GGUF quantisations | model 2 quantisation 4 | apache-2.0 | 0 / 110 / 1348 / 13482 / 14943 / 679 | 2026-08-15 |
| ByteDance/Ouro-2.6B-Thinking ByteDance/Ouro-2.6B-Thinking · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 10901 / 119 / 13013 | 2025-10-28 |
Facets
Licence 8092 of 10489 claims
apache-2.05385
Task 1343 of 10489 claims
Sources
Hugging Face models primary
The model itself: its licence, its task and how many people fetch it.
model · failing1568
GGUF quantisations high
Which quantisations exist, which is what decides whether it runs on the machine somebody has.
quantisation · current8921