Models you can run yourself
A model, every quantisation somebody made of it, and what each one costs to run.
Only one source knows: GGUF quantisations 2229 · Hugging Face models 63
Behind: zetlyn/models-hf has not completed an update.
Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
| Property | Hugging Face models | GGUF quantisations |
|---|---|---|
| Licence | cardData.license | cardData.license |
Everything else the sources say is shown side by side, and not compared.
Found
51–75 of 229| Thing | Kind | Licence | Downloads | Date |
|---|---|---|---|---|
| bytkim/Qwen3.8-27B-pi bytkim/Qwen3.8-27B-pi · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | apache-2.0 | 2632 / 528 | 2026-09-29 |
| 3MPER0RR/gpt-oss-20b-3MPER0RR-abliterated 3MPER0RR/gpt-oss-20b-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1133 / 2551 / 751 / 783 | 2026-09-11 |
| Allen-UQ/CNY-14B Allen-UQ/CNY-14B · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1008 / 19 / 2339 / 83 | 2026-08-27 |
| 3MPER0RR/Mistral-7B-v0.3-3MPER0RR-abliterated 3MPER0RR/Mistral-7B-v0.3-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 2313 / 678 / 723 / 725 | 2026-09-07 |
| EldritchLabs/MN-Aura-12B-v1 EldritchLabs/MN-Aura-12B-v1 · Hugging Face models, GGUF quantisations | model 2 quantisation 3 | apache-2.0 | 119 / 2258 / 360 / 387 / 468 | 2026-09-25 |
| DollarCoderX/Air-nano DollarCoderX/Air-nano · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 2217 / 701 / 721 / 861 | 2026-09-06 |
| aimeri/spoomplesmaxx-thrasher-24B aimeri/spoomplesmaxx-thrasher-24B · Hugging Face models, GGUF quantisations | model 2 quantisation 4 | apache-2.0 | 2185 / 221 / 235 / 273 / 395 / 731 | 2026-08-27 |
| ayoubkirouane/Sophea-Nemo-3-Nano-v1 ayoubkirouane/Sophea-Nemo-3-Nano-v1 · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 160 / 171 / 2039 / 544 | 2026-09-16 |
| brucoder/WINTER-FROST-2-PRO brucoder/WINTER-FROST-2-PRO · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1902 / 295 / 641 / 932 | 2026-08-31 |
| DrRiceIO7/Franken-MoE-Large-Base DrRiceIO7/Franken-MoE-Large-Base · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1011 / 1873 / 468 / 999 | 2026-09-15 |
| empero-ai/Qwen3.8-4B-Distill empero-ai/Qwen3.8-4B-Distill · Hugging Face models, GGUF quantisations | model 2 quantisation 6 | apache-2.0 | 0 / 110 / 11939 / 12162 / 1844 / 518 / 995 | 2026-08-15 |
| Berkelium-ai/BerkeliumGPT2-Coder-3b Berkelium-ai/BerkeliumGPT2-Coder-3b · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1825 / 367 / 376 / 400 | 2026-09-22 |
| AuroraSystem/Clary-2-Cyber-Heavy-4B AuroraSystem/Clary-2-Cyber-Heavy-4B · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1768 / 611 / 680 / 798 | 2026-09-10 |
| chaoliangUNSW/Jev-Style-Qwen3.5-2B-Decision-v2 chaoliangUNSW/Jev-Style-Qwen3.5-2B-Decision-v2 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 1043 / 1397 / 1762 | 2026-09-23 |
| apus-ailab/APUS-OpenJev-v1-4B apus-ailab/APUS-OpenJev-v1-4B · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1080 / 1741 / 824 | 2026-09-22 |
| ai-nexuz/llama-3.2-1b-instruct-fine-tuned ai-nexuz/llama-3.2-1b-instruct-fine-tuned · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 1685 / 534 / 584 | 2024-11-22 |
| ermiaazarkhalili/Qwen3.8-2B-Function-Calling-xLAM-Unsloth ermiaazarkhalili/Qwen3.8-2B-Function-Calling-xLAM-Unsloth · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 1679 / 186 / 189 | 2026-08-19 |
| ApolloRaines/Qwen2.5-14B-Noncompliant ApolloRaines/Qwen2.5-14B-Noncompliant · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1651 / 309 / 334 / 431 | 2026-09-19 |
| armand0e/Granite-4.2-30B-Fable-Distill armand0e/Granite-4.2-30B-Fable-Distill · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1613 / 214 / 242 / 688 | 2026-08-28 |
| aiuser3993/AMD-OLMo-1B-IT aiuser3993/AMD-OLMo-1B-IT · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1602 / 182 / 441 / 847 | 2026-09-01 |
| AuroraSystem/Clary-2-Cyber-Flash-1.7B AuroraSystem/Clary-2-Cyber-Flash-1.7B · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1582 / 483 / 523 / 543 | 2026-09-10 |
| agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 / other | 1549 / 75023 / 87780 | 2026-08-28 |
| aemmeath/MiniCPM5-Astra aemmeath/MiniCPM5-Astra · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1542 / 220 / 229 / 446 | 2026-09-16 |
| artindnr/BlueBerry-3 artindnr/BlueBerry-3 · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 1533 / 272 / 293 / 726 | 2026-09-05 |
| arelath/Hemmingway-1-heretic-adapter arelath/Hemmingway-1-heretic-adapter · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 | 0 / 1509 | 2026-09-22 |
Facets
Licence 8160 of 10579 claims
apache-2.04532
Sources
Hugging Face models primary
The model itself: its licence, its task and how many people fetch it.
model · partial1568
GGUF quantisations high
Which quantisations exist, which is what decides whether it runs on the machine somebody has.
quantisation · current9011