GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
SvS Qwen 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
OC
OceanGPT Basic 4B Thinking
Oceangpt · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
RE
Rei 12B i1
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
EV
Evil Alpaca Right Lean L3.2 3B i1
Evil · BasedAGI
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SY
SynLogic 7B
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
GL
Zai org.GLM 5.1
GLM · DevQuasar-14
Params754B
Context198K
Q4_K_M454.9 GB
ReasoningTool use
NE
Neo 3 3B A400M Base
Neo · mradermacher
Params3.11B
Context32K
Q4_K_M2.1 GB
CodingReasoningTool use
TO
Tolk Flash
Tolk · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
SP
speed synthesis 8b senior i1
Speed · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VG
VGPO RL 32B
Vgpo · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
ReasoningVision
NU
NuExtract 1.5 Smol
Nuextract · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Embedding
GU
GUI Owl 1.5 32B Think
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
ReasoningTool use
OR
Ornith 1.5 122B GSQ RCO
Ornith · fajardc
Params122B
Context256K
Smallest53.4 GB
ReasoningTool use
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous Capybara 7B V1.9
Nous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Orca_Mini_Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
Entropy Qwen3 4B Base
Qwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
ReasoningTool use
MI
Zero-Mistral
Mistral · ZeroAgency
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
LUFFY Qwen Math 7B Zero
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
Reasoning
PH
microsoft.Phi 4 Reasoning Plus
Phi · DevQuasar
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 1.5B abliterated
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LI
Ling 3.0 Flash
Ling · sdwilsh
Params127B
Context256K
Smallest76.0 GB
ReasoningTool use
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
GL
GLM 4.7 Flash
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
ST
STELLA VLM FineBio 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
MiMo-V2.6-Flash-RL
Mimo · MorinoNushi
Params309B
Context1024K
Smallest167.4 GB
ReasoningTool use
QW
VibeThinker-1.5B
Qwen · Mungert
Params1.78B
Context128K
Q4_K_M1.3 GB
CodingTool use
CH
Chimpgpt Coder Elite
Chimpgpt · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
CodingReasoningTool use

Keep browsing