Models you can run yourself
A model, every quantisation somebody made of it, and what each one costs to run.
Only one source knows: GGUF quantisations 2276 · Hugging Face models 62
Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
| Property | Hugging Face models | GGUF quantisations |
|---|---|---|
| Licence | cardData.license | cardData.license |
Everything else the sources say is shown side by side, and not compared.
Found
26–50 of 1,112| Thing | Kind | Licence | Downloads | Date |
|---|---|---|---|---|
| audio-cpp/VibeVoice-7B-GGUF vibevoice/VibeVoice-7B · GGUF quantisations | quantisation 1 | mit | 28476 | 2026-08-28 |
| mradermacher/Qwen3.8-14B-Instruct-Turbo-GGUF ewinregirgojr/Qwen3.8-14B-Instruct-Turbo · GGUF quantisations | quantisation 2 | apache-2.0 | 14093 | 2026-08-29 |
| js-byte/Audio8-TTS-Preview-0.6b-GGUF Audio8/Audio8-TTS-Preview-0.6b · GGUF quantisations | quantisation 2 | apache-2.0 | 26800 | 2026-08-31 |
| nvidia/Nemotron-3-Diarization · GGUF quantisations | quantisation 1 | openmdw-1.1 | 26428 | 2026-09-01 |
| Rewnozom/Rewnozom-GGUF Rewnozom/Rewnozom · GGUF quantisations | quantisation 1 | apache-2.0 | 24752 | 2026-08-30 |
| BoldingBuilds/orcarouter_GLM-5.3-Flash-Uncensored-GGUF orcarouter/GLM-5.3-Flash-Uncensored-FP8 · GGUF quantisations | quantisation 2 | mit | 23894 | 2026-08-31 |
| jan1k/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-NVFP4-GGUF HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF · GGUF quantisations | quantisation 9 | apache-2.0 | 0 | 2026-08-30 |
| EryriLabs/phonellm-alpha-1-GGUF pipecat-ai/phonellm-alpha-1 · GGUF quantisations | quantisation 6 | bsd-2-clause | 114 | 2026-08-28 |
| L-Alchemyst/GLM-5.3-GGUF zai-org/GLM-5.3-BF16 · GGUF quantisations | quantisation 5 | other | 0 | 2026-08-28 |
| bartowski/TheDrummer_Orion-26B-A4B-v1-GGUF TheDrummer/Orion-26B-A4B-v1 · GGUF quantisations | quantisation 4 | — | 21787 | 2026-08-26 |
| cdanis/Ornith-1.5-397B-GGUF-imatrix ornith-ai/Ornith-1.5-397B · GGUF quantisations | quantisation 2 | — | 20262 | 2026-08-30 |
| mradermacher/Qwen3-Coder-Next-Uncensored-Heretic-i1-GGUF llmfan46/Qwen3-Coder-Next-Uncensored-Heretic · GGUF quantisations | quantisation 3 | apache-2.0 | 1380 | 2026-08-30 |
| Akicou/Qwen3.8-Flash-Next-REAM-60Pct Akicou/Qwen3.8-Flash-Next-REAM-60Pct · Hugging Face models, GGUF quantisations | model 2 quantisation 4 | other | 11329 / 16704 / 3191 / 386 / 645 | 2026-08-29 |
| atakhadivi/Qwen3.8-2B-Uncensored-GGUF empero-ai/Qwen3.8-2B · GGUF quantisations | quantisation 3 | apache-2.0 | 15373 | 2026-08-27 |
| atakhadivi/Qwen3.8-2B-Uncensored-GGUF Qwen/Qwen3.5-2B · GGUF quantisations | quantisation 33 | apache-2.0 | 0 | 2026-08-27 |
| nuofang/Qwen3.8-9B-Distill-SLERP-F451-Pro-Writer-Uncensored-GGUF nuofang/Qwen3.8-9B-Distill-SLERP-F451-Pro-Writer-Uncensored · GGUF quantisations | quantisation 3 | — | 15184 | 2026-08-29 |
| cruizba/ISTA-DASLab-Qwen3.8-27B-GSQ-RCO-GGUF-Unsloth-MTP ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF · GGUF quantisations | quantisation 5 | apache-2.0 | 13734 | 2026-08-31 |
| cruizba/ISTA-DASLab-Qwen3.8-27B-GSQ-RCO-GGUF-Unsloth-MTP unsloth/Qwen3.8-27B-GGUF · GGUF quantisations | quantisation 13 | apache-2.0 | 0 | 2026-08-30 |
| BreezeBlue/Breeze-TTS-2 BreezeBlue/Breeze-TTS-2 · Hugging Face models, GGUF quantisations | model 2 quantisation 4 | other | 12926 / 13392 / 13570 / 1927 / 558 / 946 | 2026-08-25 |
| SpeakoFlow/speakoflow-mini Qwen/Qwen3.5-0.8B · GGUF quantisations | quantisation 42 | apache-2.0 | 0 | 2026-08-28 |
| LuffyTheFox/Tiel-Coder-35B-A3B-Genesis-Hermes-GGUF ornith-ai/Ornith-1.5-35B-A3B · GGUF quantisations | quantisation 32 | apache-2.0 | 0 | 2026-08-27 |
| 0bserverx/RVN-Qwen3.8-Flash-Next-Abliterated-Uncensored 0bserverx/RVN-Qwen3.8-Flash-Next-Abliterated-Uncensored · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 / other | 1021 / 12829 / 53197 / 594 | 2026-08-31 |
| mradermacher/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-heretic-NOESIS-BF16-i1-GGUF AMAImedia/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-heretic-NOESIS-BF16 · GGUF quantisations | quantisation 2 | apache-2.0 | 11747 | 2026-09-02 |
| 3MPER0RR/gemma-4-31b-it-3MPER0RR-abliterated 3MPER0RR/gemma-4-31b-it-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 | 107 / 11163 / 134 / 2474 | 2026-09-01 |
| ApolloRaines/Jenzin-Wuang-Nemotron-30B-A3B-BF16 ApolloRaines/Jenzin-Wuang-Nemotron-30B-A3B-BF16 · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | other | 10491 / 1117 / 1927 / 2406 | 2026-09-02 |
Facets
Sources
Hugging Face models primary
The model itself: its licence, its task and how many people fetch it.
model · failing1568
GGUF quantisations high
Which quantisations exist, which is what decides whether it runs on the machine somebody has.
quantisation · current8921