GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo VL 7B RL 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
LL
StruXGPT v2 Llama2 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SM
SinhalaLLM
SmolLM · Captainsl
Params1.9B
Context8K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B DASHQ Q2
DeepSeek · jkim96
Params8.19B
Context128K
Smallest2.6 GB
ReasoningTool use
AL
ALMA 13B R
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
CodingTool use
SU
sum small
Sum · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LI
Ling 3.0 Flash Fin
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
ReasoningTool use
PH
GRAG PHI 3.5 MINI 4B MERGED HESSIAN AI i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
QW
UnifiedReward 2.0 Qwen3Vl 2b
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool use
CL
clip text base
Clip · cstr
Params63M
Context—
Smallest0.0 GB
GGUF
SY
SynthAgent SFT UI TARS 1.5 7B
Synthagent · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OR
Ornith 1.5 9B Abliterated ROCmFP4
Ornith · kingjones777
Params8.95B
Context256K
Smallest5.1 GB
ReasoningTool useVision
MU
multilingual e5 large
Multilingual · cstr
Params559M
Context514
Smallest0.4 GB
Embedding
QW
CoReward Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
GP
GPT NoSleep 355m i1
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
SL
Slot_Mllm_14B
Slot · mradermacher
Params14.9B
Context32K
Q4_K_M9.0 GB
Tool use
MA
MarsRL
Marsrl · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
OC
OceanGPT Basic 8B
Oceangpt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
GH
ghost 7b v0.9.1
Ghost · ghost-x
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ON
oneirogen-7B
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
SY
SynthAgent SFT UI TARS 1.5 7B
Synthagent · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
DR
DRIFT VL 7B
Drift · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
PH
Phi 4 Reasoning
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoningTool use
GL
Zai org.GLM 4.5 Air
GLM · DevQuasar
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
BI
bitnet_b1_58-xl
Bitnet · BoscoTheDog
Params1.27B
Context2K
Smallest1.6 GB
GGUF
KU
Kuvera 8B v0.1.0
Kuvera · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
CH
ChineseErrorCorrector 7B
Chineseerrorcorrector · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PH
phi 4
Phi · QuantFactory
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
SE
SEA LION v1 7B
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB
GGUF

Keep browsing