GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
SA
Saul 7B Base
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Dirty-Alice-Tiny-1.1B-v1
Dirty · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
Maral 7B alpha 1
Maral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Prox MistralHermes 7B GGUF IQ Imatrix Request
Mistral · LWDCLS
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen 2 5 1 5b instruct using openai gsm8k data enhanced with deepseek v4
Qwen · eagle0504
Params1.54B
Context32K
Q4_K_M1.0 GB
IN
InnoSpark HPC RM 32B
Innospark · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DA
Damysus 2.7B Chat i1
Damysus · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
doktor Mistral trendyol 7b
Mistral · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
LL
Phi 3.5 Mini Instruct
Llama · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 2 Layla v1 Chatml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
YI
Faro Yi 34B
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
PAPO G Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
QW
Aratako.Qwen3 8B NSFW JP
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Tool Star Qwen 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
BlackSheep Llama3.2 3B
Llama · BasedAGI
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
MiMo Embodied 7B
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
BI
BioXP 0.5B MedMCQA
Bioxp · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CA
CarbonVillain en 10.7B v3
Carbonvillain · LiteLLMs
Params10.7B
Context4K
Q4_K_M6.5 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · squ0sh
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MiniMax M2
Minimax · redponike
Params229B
Context192K
Q4_K_M138.3 GB
GI
GigaChat 20B A3B Base
Gigachat · mradermacher
Params20.6B
Context128K
Q4_K_M12.5 GB
MI
Nexus IKM Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
GLM 4.5 Air REAP 82B A12B i1
GLM · mradermacher
Params85B
Context128K
Smallest0.2 GB
SA
Sam flash mini v1
Sam · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GE
GEN 1 i1
Gen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · abhinand
Params474M
Context256K
Q4_K_M0.3 GB
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LI
Lingshu 32B
Lingshu · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
OR
Ornith-1.5-35B
Ornith · LemesoftNostalgic
Params35.5B
Context256K
Smallest18.2 GB
LL
llama 2 7b Persian
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB