GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
ShieldVLM 7B Qwen
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OR
Ornith 1.5 35B A3B Q3K Q4K8 emb8 16.9GB
Ornith · dgaretz
Params34.7B
Context256K
Smallest16.9 GB
QW
Entropy Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
VI
VinaLlama2 14B
Vinallama · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
CO
AI Control LoRA
Control · MSI-AI-Group
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
MiroThinker v1.0 72B
Mirothinker · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
SA
sarashina2.2-3b-instruct-v0.1
Sarashina · neody
Params3.36B
Context8K
Q4_K_M2.1 GB
QW
qwen 2.5 coder 1.5b svelte
Qwen · kusonooyasumi
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Sombrero QwQ 32B Elite11
Qwen · BasedAGI
Params32.8B
Context128K
Q4_K_M19.9 GB
OR
Potato-CODER-12GB
Ornith · Slomin
Params34.7B
Context256K
Smallest13.2 GB
LL
Seneca Cybersecurity LLM Q4 K M
Llama · AlicanKiraz0
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Pokemon Red Qwen3 80B
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
X1 Qwen3vl LoRA
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
FA
Fara1.5 9B
Fara · webmp3
Params8.95B
Context256K
Smallest4.2 GB
LL
ARENA Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NI
NietzscheGPT
Nietzschegpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · neody
Params7.62B
Context128K
Smallest5.4 GB
QW
Gemini 3.1 Pro Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
VI
Vibethinker
Vibethinker · pfeifferj
Params3.09B
Context128K
Smallest1.2 GB
XA
XALMA 13B Pretrain
Xalma · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepSeek V4 Flash
DeepSeek · sleepyeldrazi
Params178B
Context1024K
Smallest91.3 GB
PL
Planium 4B
Planium · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
LL
Llama 2 13b Hf
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
RE
ReForm SFT 7B
Reform · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
RL
rlve opd teacher R1Distill 126 MinimumUnconflictedGridKMax 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
GL
GLM 5.2 GGUF 2.244bpw
GLM · sokann
Params753B
Context1024K
Smallest211.3 GB
SI
Siithamo
Siithamo · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chocolatine Cook 3B combined SFT DPO v0.1
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
QW
SmaliLLM Qwen2.5 Coder 0.5B Instruct Finetuned
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
LE
LegalOne R1 4B
Legalone · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB