GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
BG
bge m3
BGE · cstr
Params567M
Context8K
Smallest0.4 GB
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GP
Codette-Ultimate-V4
gpt-oss · Raiff1982
Params32B
Context128K
Q4_K_M19.4 GB
NU
NuExtract 2.0 8B
Nuextract · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LI
Ming Image 0.1 Design
Ling · voltaire321
Params6.15B
Context—
Smallest6.5 GB
LL
DevQuasar R1 Uncensored Llama 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest98.8 GB
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
KW
KwaiCoder DS V2 Lite Base
Kwaicoder · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
LightGPT 0.5B Qwen2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
RI
Ring Lite Distill Preview
Ring · mradermacher
Params16.8B
Context16K
Q4_K_M11.2 GB
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
IN
InnoSpark 7B 0715
Innospark · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
MiMo V2.6 Distill Qwen 9B NVFP4
Qwen · prithivMLmods
Params9.2B
Context256K
Smallest7.0 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 3.5 mini 3.8b instruct
Phi · lm-kit
Params3.82B
Context128K
Q4_K_M2.4 GB
GE
Gemma 4 Rust Coder
Gemma · Titaniumclock
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AS
astrollama 3 8b base aic
Astrollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
PH
Phi 3 mini 128k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context128K
Q4_K_M2.4 GB
GL
GLM-4.5-Air
GLM · ggml-org
Params107B
Context128K
Q4_K_M63.6 GB
ON
oneirogen-0.5B
Oneirogen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
MI
Midm 2.0 Base Instruct
Midm · gchrisoh
Params11.5B
Context32K
Q4_K_M7.0 GB
LI
Ling 3.0 Tiny
Ling · Ninnix96
Params7.89B
Context128K
Smallest5.1 GB
KI
Kimi Dev 72B
Kimi · gabriellarson
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
llama 3.1 medprm reward v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Midm 2.0 Base Instruct 128K
Midm · mradermacher
Params11.5B
Context128K
Q4_K_M7.0 GB