GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
MetaAligner HH RLHF 1.1B i1
Metaaligner · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Self Certainty Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
PH
Phi 3 medium 128k instruct
Phi · thesven
Params14B
Context128K
Q4_K_M8.6 GB
Coding
FU
functionary medium v3.1 i1
Functionary · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
IN
IntentRL Ambig Text2SQL 4B
Intentrl · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool use
FU
functionary small v3.1
Functionary · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
QW
Huihui Qwen3 30B A3B Abliterated Fusion 9010
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
GL
GLM 4.7 Flash MTP
GLM · meshllm
Params31.2B
Context198K
Q4_K_M18.9 GB
GGUF
OR
Ornith 1.5 35B A3B abliterated NVFP4 DFlash
Ornith · pottokao
Params34.7B
Context256K
Smallest0.8 GB
ReasoningTool use
GP
Gpt Oss 20b Ilograph Instruct
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GE
MS Gemma 3 12b
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
SY
SynLogic 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
QW
Entropy Qwen3 8B Base OpenRS
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
GGUF
FR
Lumen
Fresco · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
Athena Llamamerge 70B
DeepSeek · mradermacher
Params69.7B
Context128K
Q4_K_M41.9 GB
Tool use
GR
Graph R1 7B
Graph · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningTool use
NP
NPC LLM 3 8B i1
Npc · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
AR
ArcherCodeR 1.5B DAPO
Archercoder · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
BA
baby dolphin 2.0
Baby · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
QW
Qwen2.5 Coder 7B Playable MI355 Lora Tuned
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CH
Chocolatine Cook 3B combined SFT DPO v0.1 i1
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
SI
SIRL COPT
Sirl · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen3 8B ERP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
TO
Tolk 7B
Tolk · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
CH
chatterbox finnish nano
Chatterbox · JJarvinen
Params180M
Context—
Smallest0.3 GB
GGUF
DE
Huihui ai.DeepSeek V3 0324 Pruned Coder 411B
DeepSeek · DevQuasar-4
Params426B
Context160K
Q4_K_M256.6 GB
CodingTool use
MI
MiniMax M2 THRIFT i1
Minimax · mradermacher
Params173B
Context192K
Smallest0.4 GB
GGUF
BG
bge m3
BGE · smarttasks
Params567M
Context8K
Q4_K_M0.4 GB
Embedding

Keep browsing