GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
NO
CodeRankEmbed Q8 0
Nomic · brandtcormorant
Params137M
Context2K
Smallest0.1 GB
LE
lens
Lens · gguf-org
Params4.1B
Context—
Smallest0.2 GB
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
OmniDimen V1.5 14B Emotion
Omnidimen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
MI
StructLM 7B Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3.5 Mini Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Deductive Reasoning Qwen 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
agentflow-planner-7b
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M5.0 GB
CR
CroPond 7B
Cropond · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · servantofares
Params29.9B
Context198K
Q4_K_M18.5 GB
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
HA
Harrier Oss v1 0.6b
Harrier · SuperPauly
Params596M
Context32K
Q4_K_M0.4 GB
BG
bge large zh i1
BGE · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
LU
Lumina-2.75M
Lumina · jacopof
Params3M
Context165
Smallest0.0 GB
GL
GLM Z1 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
LI
Ling Lite
Ling · bartowski
Params16.8B
Context16K
Q4_K_M11.2 GB
OR
Ornith 1.5 35B A3B NVFP4
Ornith · TizzyT566
Params35.5B
Context256K
Smallest23.9 GB
AT
Atomight V2.2 0.5B UltraThink
Atomight · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GL
GLM 4 T1 54B
GLM · mradermacher
Params54.2B
Context32K
Q4_K_M32.7 GB
GR
Granite_42_30b_Abliterated
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
SW
SWE Star 14B
Swe · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
Qwen3 8B ERP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
OR
Ornith 1.5 397B uncensored
Ornith · Lethevimlet
Params403B
Context256K
Smallest235.2 GB
FR
Lumen i1
Fresco · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SP
SP 7B i1
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
UL
UltraLM 13B v2.0
Ultralm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB