GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
ME
MetaAligner HH RLHF 1.1B i1
Metaaligner · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Self Certainty Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
PH
Phi 3 medium 128k instruct
Phi · thesven
Params14B
Context128K
Q4_K_M8.6 GB
FU
functionary medium v3.1 i1
Functionary · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
IN
IntentRL Ambig Text2SQL 4B
Intentrl · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
FU
functionary small v3.1
Functionary · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Huihui Qwen3 30B A3B Abliterated Fusion 9010
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GL
GLM 4.7 Flash MTP
GLM · meshllm
Params31.2B
Context198K
Q4_K_M18.9 GB
OR
Ornith 1.5 35B A3B abliterated NVFP4 DFlash
Ornith · pottokao
Params34.7B
Context256K
Smallest0.8 GB
GP
Gpt Oss 20b Ilograph Instruct
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GE
MS Gemma 3 12b
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
SY
SynLogic 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Entropy Qwen3 8B Base OpenRS
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
FR
Lumen
Fresco · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Athena Llamamerge 70B
DeepSeek · mradermacher
Params69.7B
Context128K
Q4_K_M41.9 GB
GR
Graph R1 7B
Graph · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
NP
NPC LLM 3 8B i1
Npc · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
AR
ArcherCodeR 1.5B DAPO
Archercoder · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
BA
baby dolphin 2.0
Baby · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
QW
Qwen2.5 Coder 7B Playable MI355 Lora Tuned
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CH
Chocolatine Cook 3B combined SFT DPO v0.1 i1
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
SI
SIRL COPT
Sirl · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 8B ERP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
TO
Tolk 7B
Tolk · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CH
chatterbox finnish nano
Chatterbox · JJarvinen
Params180M
Context—
Smallest0.3 GB
DE
Huihui ai.DeepSeek V3 0324 Pruned Coder 411B
DeepSeek · DevQuasar-4
Params426B
Context160K
Q4_K_M256.6 GB
MI
MiniMax M2 THRIFT i1
Minimax · mradermacher
Params173B
Context192K
Smallest0.4 GB
BG
bge m3
BGE · smarttasks
Params567M
Context8K
Q4_K_M0.4 GB