GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Saul 7B Base
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
Dirty-Alice-Tiny-1.1B-v1
Dirty · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MA
Maral 7B alpha 1
Maral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Prox MistralHermes 7B GGUF IQ Imatrix Request
Mistral · LWDCLS
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
qwen 2 5 1 5b instruct using openai gsm8k data enhanced with deepseek v4
Qwen · eagle0504
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
IN
InnoSpark HPC RM 32B
Innospark · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
DA
Damysus 2.7B Chat i1
Damysus · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MI
doktor Mistral trendyol 7b
Mistral · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Phi 3.5 Mini Instruct
Llama · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Layla v1 Chatml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
YI
Faro Yi 34B
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
PAPO G Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Vision
QW
Aratako.Qwen3 8B NSFW JP
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Tool Star Qwen 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
BlackSheep Llama3.2 3B
Llama · BasedAGI
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
MiMo Embodied 7B
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
BI
BioXP 0.5B MedMCQA
Bioxp · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
CA
CarbonVillain en 10.7B v3
Carbonvillain · LiteLLMs
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · squ0sh
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MI
MiniMax M2
Minimax · redponike
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
GI
GigaChat 20B A3B Base
Gigachat · mradermacher
Params20.6B
Context128K
Q4_K_M12.5 GB
GGUF
MI
Nexus IKM Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
GLM 4.5 Air REAP 82B A12B i1
GLM · mradermacher
Params85B
Context128K
Smallest0.2 GB
GGUF
SA
Sam flash mini v1
Sam · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
GE
GEN 1 i1
Gen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen3.6 35B A3B DFlash
Qwen · abhinand
Params474M
Context256K
Q4_K_M0.3 GB
ReasoningTool use
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LI
Lingshu 32B
Lingshu · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Reasoning
OR
Ornith-1.5-35B
Ornith · LemesoftNostalgic
Params35.5B
Context256K
Smallest18.2 GB
ReasoningTool useVision
LL
llama 2 7b Persian
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing