Models you can run yourself

A model, every quantisation somebody made of it, and what each one costs to run.

Behind2 sourcesupdated 5h agofresh within 24h
3,246things
862named by two sources or more
34conflicts
2sources

Only one source knows: GGUF quantisations 2317 · Hugging Face models 67

Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
PropertyHugging Face modelsGGUF quantisations
LicencecardData.licensecardData.license

Everything else the sources say is shown side by side, and not compared.

kind=quantisation ✕kind=quantisation ✕licence=mit ✕

EverythingQuantised, and openly licensedmodel 1647quantisation 9398

Found

1–25 of 58
ThingKindLicenceDownloadsDate
Lynxpda/micro-qwen4exp
· GGUF quantisations · matched qwen
quantisation 1 mit4222026-09-01
ii6uu99/qwen3.8-2b
· GGUF quantisations · matched qwen
quantisation 1 mit342026-09-29
Leonther/sentinel-qwen38-27b-q4
unsloth/Qwen3.8-27B-GGUF · GGUF quantisations · matched qwen
quantisation 12 apache-2.002026-08-30
TitanMamo10/qwen25-qat-q3-poc
Qwen/Qwen2.5-0.5B · GGUF quantisations · matched qwen
quantisation 2 apache-2.01562026-09-06
TitanMamo10/qwen25-qat-q3-poc
Qwen/Qwen2.5-1.5B · GGUF quantisations · matched qwen
quantisation 2 apache-2.01332026-09-02
lddl16/qwen3.5-2b_code_gguf
Qwen/Qwen3.5-2B · GGUF quantisations · matched qwen
quantisation 36 apache-2.002026-08-31
tinyopsec/bible-assistant-qwen35-4b-GGUF
Ttimms/Bible-Assistant-Qwen3.5-4B-v2 · GGUF quantisations · matched qwen
quantisation 2 apache-2.021612026-09-17
2048lr/Qwen3.5-0.8B-Amiya
Qwen/Qwen3.5-0.8B · GGUF quantisations · matched qwen
quantisation 46 apache-2.002026-08-28
Dexter2k1/qwen2.5-0.5b-derivadas
· GGUF quantisations · matched qwen
quantisation 1 mit1172026-10-02
marvijarrin/qwen2.5-coder-7b-minigui-extended
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF · GGUF quantisations · matched qwen
quantisation 1 mit682026-09-27
VladHong/Qwen3.5-9B-Ornimo-SLERP-GGUF
XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B · GGUF quantisations · matched qwen
quantisation 34 apache-2.002026-09-21
VladHong/Qwen3.5-9B-Ornimo-SLERP-GGUF
ornith-ai/Ornith-1.5-9B · GGUF quantisations · matched qwen
quantisation 18 apache-2.010052026-08-27
2048lr/Qwen3.5-0.8B-Amiya
2048lr/Qwen3.5-0.8B-Amiya · Hugging Face models, GGUF quantisations · matched qwen
model 2 quantisation 1 mit1240 / 453 / 4852026-09-09
Godners/dao-zang-sft-qwen2.5-7b
Qwen/Qwen2.5-7B-Instruct · GGUF quantisations · matched qwen
quantisation 32 apache-2.002026-08-27
2048lr/Qwen2.5-1.5B-Instruct-Amiya
· GGUF quantisations · matched qwen
quantisation 1 mit3002026-09-08
Brancis/DeepSeek-R1-Qwen-32B-Uncensored
Brancis/DeepSeek-R1-Qwen-32B-Uncensored · Hugging Face models, GGUF quantisations · matched qwen
model 2 quantisation 2 mit0 / 2609 / 41492026-09-07
yethdev/qwen3.5-9b-manumit-v2-GGUF
yethdev/qwen3.5-9b-manumit-v2 · GGUF quantisations · matched qwen
quantisation 1 mit2182026-09-06
yethdev/qwen3.5-4b-manumit-v2-GGUF
yethdev/qwen3.5-4b-manumit-v2 · GGUF quantisations · matched qwen
quantisation 1 mit2662026-09-06
yethdev/qwen3.5-2b-manumit-v2-GGUF
yethdev/qwen3.5-2b-manumit-v2 · GGUF quantisations · matched qwen
quantisation 1 mit1942026-09-06
xian-taidu/Qwen3-ASR-1.7B-DML
· GGUF quantisations · matched qwen
quantisation 1 mit332026-09-04
mradermacher/judaism-llm-qwen2.5-7b-GGUF
tdw419/judaism-llm-qwen2.5-7b · GGUF quantisations · matched qwen
quantisation 1 mit6732026-09-02
Beinsezii/Qwen3.8-Flash-Next-GGUF-HALO
Qwen/Qwen3.8-Flash-Next · GGUF quantisations · matched qwen
quantisation 122 apache-2.002026-08-26
theplayboy117/Marv-Qwen2.5-0.5B-GGUF
· GGUF quantisations · matched qwen
quantisation 1 mit792026-10-02
deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
deepseek-ai/DeepSeek-R1-0528-Qwen3-8B · Hugging Face models, GGUF quantisations · matched qwen
model 1 quantisation 1 mit694922 / 872025-05-29
webmp3/Sakura-Qwen3.8-Flash-Next-Overview
· GGUF quantisations · matched qwen
quantisation 1 mit02026-10-02
← PreviousPage 1 of 3Next →

Facets

Kind 11045 of 11045 claims

model1647

Source 11045 of 11045 claims

Licence 8554 of 11045 claims

mit749

Sources

Hugging Face models primary

The model itself: its licence, its task and how many people fetch it.

model · failing1647

GGUF quantisations high

Which quantisations exist, which is what decides whether it runs on the machine somebody has.

quantisation · current9398