GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 i1
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TA
TAMA vA i1
Tama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OM
OmniDimen V1.5 7B Emotion
Omnidimen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
GL
ArliAI_GLM 4.5 Air Derestricted_REAP50_Creative
GLM · mradermacher
Params57B
Context128K
Q4_K_M37.4 GB
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
SV
SVILA 1 12B
Svila · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
HE
Hebrew-GPT2-345M-Stage
Hebrew · Norod78
Params406M
Context1K
Smallest0.8 GB
SI
silero-vad
Silero · sakasegawa
Params—
Context—
Smallest0.0 GB
AL
XALMA 13B Pretrain
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SC
SCOPED 4B
Scoped · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Technomancer
Qwen · ChonkE
Params27.3B
Context256K
Q4_K_M16.8 GB
NU
NuExtract 2.0 8B
Nuextract · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
ServiceNow AI.Apriel 1.6 15b Thinker
Apriel · DevQuasar
Params14.4B
Context256K
Q4_K_M8.8 GB
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
PS
Psychological_Counseling_Model_for_Occupational_Anxiety_in_Obese_Patients
Psychological · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
PR
Pristine 8B A1B
Pristine · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
PI
pix2tex mfr
Pix · cstr
Params29M
Context—
Smallest0.0 GB
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ZR
ZR1 1.5B
mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
HI
hikari-medium
Hikari · cstr
Params764M
Context—
Smallest0.9 GB
ST
state-0
State · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
TI
TinyLlama 3T Cinder v1.2
Tinyllama · Josephgflowers
Params1.1B
Context2K
Smallest1.2 GB
KV
Ai Kvm Grounder 8b
Kvm · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
MI
XiaomiMiMo.MiMo V2.6 Pro RL
Mimo · DevQuasar
Params1020B
Context1024K
Smallest373.5 GB
FU
functionary medium v3.1
Functionary · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB