GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 i1
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
TA
TAMA vA i1
Tama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OM
OmniDimen V1.5 7B Emotion
Omnidimen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
GGUF
GL
ArliAI_GLM 4.5 Air Derestricted_REAP50_Creative
GLM · mradermacher
Params57B
Context128K
Q4_K_M37.4 GB
GGUF
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
SV
SVILA 1 12B
Svila · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
HE
Hebrew-GPT2-345M-Stage
Hebrew · Norod78
Params406M
Context1K
Smallest0.8 GB
GGUF
SI
silero-vad
Silero · sakasegawa
Params—
Context—
Smallest0.0 GB
GGUF
AL
XALMA 13B Pretrain
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SC
SCOPED 4B
Scoped · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
QW
Technomancer
Qwen · ChonkE
Params27.3B
Context256K
Q4_K_M16.8 GB
Roleplay
NU
NuExtract 2.0 8B
Nuextract · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AP
ServiceNow AI.Apriel 1.6 15b Thinker
Apriel · DevQuasar
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
PS
Psychological_Counseling_Model_for_Occupational_Anxiety_in_Obese_Patients
Psychological · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PR
Pristine 8B A1B
Pristine · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
Tool use
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
GGUF
PI
pix2tex mfr
Pix · cstr
Params29M
Context—
Smallest0.0 GB
GGUF
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
Tool use
ZR
ZR1 1.5B
mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingTool use
HI
hikari-medium
Hikari · cstr
Params764M
Context—
Smallest0.9 GB
GGUF
ST
state-0
State · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
TI
TinyLlama 3T Cinder v1.2
Tinyllama · Josephgflowers
Params1.1B
Context2K
Smallest1.2 GB
GGUF
KV
Ai Kvm Grounder 8b
Kvm · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Tool useVision
MI
XiaomiMiMo.MiMo V2.6 Pro RL
Mimo · DevQuasar
Params1020B
Context1024K
Smallest373.5 GB
ReasoningTool useVision
FU
functionary medium v3.1
Functionary · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF

Keep browsing