GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
SvS Qwen 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
OC
OceanGPT Basic 4B Thinking
Oceangpt · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
RE
Rei 12B i1
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
EV
Evil Alpaca Right Lean L3.2 3B i1
Evil · BasedAGI
Params3.21B
Context128K
Q4_K_M2.0 GB
SY
SynLogic 7B
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GL
Zai org.GLM 5.1
GLM · DevQuasar-14
Params754B
Context198K
Q4_K_M454.9 GB
NE
Neo 3 3B A400M Base
Neo · mradermacher
Params3.11B
Context32K
Q4_K_M2.1 GB
TO
Tolk Flash
Tolk · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
SP
speed synthesis 8b senior i1
Speed · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
VG
VGPO RL 32B
Vgpo · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
NU
NuExtract 1.5 Smol
Nuextract · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GU
GUI Owl 1.5 32B Think
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
OR
Ornith 1.5 122B GSQ RCO
Ornith · fajardc
Params122B
Context256K
Smallest53.4 GB
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous Capybara 7B V1.9
Nous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Orca_Mini_Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
Entropy Qwen3 4B Base
Qwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
MI
Zero-Mistral
Mistral · ZeroAgency
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
LUFFY Qwen Math 7B Zero
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
PH
microsoft.Phi 4 Reasoning Plus
Phi · DevQuasar
Params14.7B
Context32K
Q4_K_M9.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B abliterated
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
LI
Ling 3.0 Flash
Ling · sdwilsh
Params127B
Context256K
Smallest76.0 GB
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GL
GLM 4.7 Flash
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ST
STELLA VLM FineBio 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
MiMo-V2.6-Flash-RL
Mimo · MorinoNushi
Params309B
Context1024K
Smallest167.4 GB
QW
VibeThinker-1.5B
Qwen · Mungert
Params1.78B
Context128K
Q4_K_M1.3 GB
CH
Chimpgpt Coder Elite
Chimpgpt · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB