Models you can run yourself

A model, every quantisation somebody made of it, and what each one costs to run.

Behind2 sourcesthe promise of 24h does not hold
3,085things
793named by two sources or more
32conflicts
2sources

Only one source knows: GGUF quantisations 2229 · Hugging Face models 63

Behind: zetlyn/models-hf has not completed an update.
Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
PropertyHugging Face modelsGGUF quantisations
LicencecardData.licensecardData.license

Everything else the sources say is shown side by side, and not compared.

task=text-generation ✕task=text-generation ✕licence=mit ✕kind=quantisation ✕

EverythingQuantised, and openly licensedmodel 1568quantisation 9011

Found

1–25 of 44
ThingKindLicenceDownloadsDate
deepseek-ai/DeepSeek-V4-Flash-0731
deepseek-ai/DeepSeek-V4-Flash-0731 · Hugging Face models, GGUF quantisations
model 2 quantisation 5 mit / other3824182 / 4 / 4494615 / 5862 / 591 / 6392 / 8552026-07-31
Devopsopraiz/Baanzon-Chenni-1.5-9B
Devopsopraiz/Baanzon-Chenni-1.5-9B · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit1590 / 4950 / 982 / 9992026-09-07
3MPER0RR/DeepSeek-R1-Distill-Qwen-32B-3MPER0RR-abliterated
3MPER0RR/DeepSeek-R1-Distill-Qwen-32B-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit2388 / 4718 / 860 / 8962026-09-05
3MPER0RR/DeepSeek-R1-Distill-Qwen-14B-3MPER0RR-abliterated
3MPER0RR/DeepSeek-R1-Distill-Qwen-14B-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit1321 / 4643 / 465 / 5052026-09-12
dealignai/GLM-5.3-Flash-CYBERSECURITY-W4A16
dealignai/GLM-5.3-Flash-CYBERSECURITY-W4A16 · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit4490 / 6762 / 67752026-08-30
3MPER0RR/Ornith1.5-9B-3MPER0RR-abliterated
3MPER0RR/Ornith1.5-9B-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 4 mit1522 / 278 / 3501 / 4283 / 432 / 8312026-08-31
3MPER0RR/Ornith-1.5-35B-A3B-3MPER0RR-abliterated
3MPER0RR/Ornith-1.5-35B-A3B-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 3 mit1375 / 273 / 3640 / 490 / 5082026-09-16
3MPER0RR/DeepSeek-R1-Distill-Llama-8B-3MPER0RR-abliterated
3MPER0RR/DeepSeek-R1-Distill-Llama-8B-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 3 mit1014 / 1949 / 1996 / 3513 / 582026-09-04
DJLougen/hermes-qwen3.5-35b-a3b-GGUF
DJLougen/hermes-qwen3.5-35b-a3b-GGUF · Hugging Face models, GGUF quantisations
model 2 quantisation 1 apache-2.0 / mit3181 / 3690 / 43752026-03-31
3MPER0RR/GLM-4.6V-Flash-3MPER0RR-abliterated
3MPER0RR/GLM-4.6V-Flash-3MPER0RR-abliterated · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit2693 / 546 / 578 / 7012026-09-19
ai-sage/GigaChat3.5-432B-A28B-Reasoning-bf16
ai-sage/GigaChat3.5-432B-A28B-Reasoning-bf16 · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit135 / 2094 / 472 / 5342026-09-03
dealignai/GLM-5.3-UNCENSORED-FP8
dealignai/GLM-5.3-UNCENSORED-FP8 · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1715 / 2632 / 27292026-08-30
ArliAI/GLM-4.5-Air-Derestricted
ArliAI/GLM-4.5-Air-Derestricted · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1282 / 148 / 1772025-11-24
BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored
BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1230 / 620 / 8232024-12-26
ai-sage/GigaChat3-10B-A1.8B-base
ai-sage/GigaChat3-10B-A1.8B-base · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1077 / 224 / 2362025-11-19
deepgrove/maple-preview
deepgrove/maple-preview · Hugging Face models, GGUF quantisations
model 2 quantisation 3 mit2568 / 2572 / 36 / 650 / 9762026-08-04
CMSManhattan/JiRackDeltaNet_27b
CMSManhattan/JiRackDeltaNet_27b · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit551790 / 553715 / 6642026-08-29
CodeDevX/auralis-coder
CodeDevX/auralis-coder · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit576 / 720 / 7672026-09-11
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B · Hugging Face models, GGUF quantisations
model 2 quantisation 9 apache-2.0 / mit126 / 160 / 161 / 166 / 169 / 35 / 38 / 470297 / 538 / 78 / 9548472025-01-20
BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored
BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1139 / 457 / 4912025-01-30
GestaltLabs/DeepSeek-V4-Flash-0731-Ornstein
GestaltLabs/DeepSeek-V4-Flash-0731-Ornstein · Hugging Face models, GGUF quantisations
model 1 quantisation 1 mit400 / 4382026-09-08
deepseek-ai/DeepSeek-V4-Flash
deepseek-ai/DeepSeek-V4-Flash · Hugging Face models, GGUF quantisations
model 2 quantisation 2 mit1099375 / 1307475 / 229 / 3852026-04-22
castorini/rank_zephyr_7b_v1_full
castorini/rank_zephyr_7b_v1_full · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit351 / 5995 / 60262024-01-19
benni-ben/Rogue-HH-Instruct
benni-ben/Rogue-HH-Instruct · Hugging Face models, GGUF quantisations
model 1 quantisation 1 mit306 / 7342026-09-25
deepseek-ai/DeepSeek-V4-Flash-DSpark
deepseek-ai/DeepSeek-V4-Flash-DSpark · Hugging Face models, GGUF quantisations
model 2 quantisation 1 mit1013784 / 242 / 8146652026-06-27
← PreviousPage 1 of 2Next →

Facets

Kind 10579 of 10579 claims

model1568

Source 10579 of 10579 claims

Licence 8160 of 10579 claims

mit718

Sources

Hugging Face models primary

The model itself: its licence, its task and how many people fetch it.

model · partial1568

GGUF quantisations high

Which quantisations exist, which is what decides whether it runs on the machine somebody has.

quantisation · current9011