GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PH
microsoft.phi 4
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
NU
NuMarkdown-8B-Thinking
Numarkdown · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
TI
TIGER OM
Tiger · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Qwen3.6 27B DFlash
Qwen · Anbeeld
Params1.73B
Context256K
Q4_K_M1.0 GB
CodingEmbeddingReasoning
YA
yaoi v1 instruct i1
Yaoi · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
OP
Open1 1.5B Instruct
Open · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · hassenhamdi
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
RA
rank1 7b
Rank · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
EmbeddingTool use
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
shisa v2.1 unphi4 14b
Shisa · XpressAI
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Smallest69.7 GB
ReasoningTool use
LU
Luna 7B A4B
Luna · mradermacher
Params6.71B
Context256K
Q4_K_M4.1 GB
ReasoningRoleplayTool use
LL
llm4decompile 6.7b v2 Q4 K M
Llm · Th3S
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
JA
Jailbreak Generator
Jailbreak · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
FL
Flashlight v1.0 i1
Flashlight · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
JI
JiRackUltra_1b
Jirackultra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
LightThinker Plus Qwen
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
PH
Phi3 ITA mini 4K instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
OP
OptiMind SFT
Optimind · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · mradermacher
Params85B
Context128K
Smallest34.6 GB
ReasoningTool use
QW
PAPO G Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Vision
MI
MistralHermes CodePro 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
UL
UltraCM 13B
Ultracm · alvarobartt
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AC
acestep-v15-turbo
Ace · DKTechin
Params4.19B
Context32K
Q4_K_M1.4 GB
GGUF
MI
MiroThinker v1.5 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
ED
EduHelp 8B
Eduhelp · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
Trendmicro ailab.Llama Primus Reasoning
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
SE
SeaLLMs v3 1.5B Chat Uncensored i1
Seallms · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF

Keep browsing