GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi Lthy4
Phi · bartowski
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
GL
GLM 4 9B 0414 Abliterated
GLM · Melvin56
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
FU
functionary medium v3.2
Functionary · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TE
TEA ASR 1.1 Fmt
Tea · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
CodingVision
AL
AllwissenGPT 7B
Allwissengpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
TheStageAI/gemma-4-E4B-it-qat-GGUF-M
Gemma · TheStageAI
Params7.46B
Context128K
Smallest4.0 GB
GGUF
PH
torchlight phi4 mini
Phi · samadpls
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
BI
BioQwen-0.5B
Bioqwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
FI
fietje 2 i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
GP
gpt oss 504
gpt-oss · Exorn
Params120B
Context128K
Smallest0.0 GB
GGUF
MI
Bangla Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
Pwdz 1 Uncensored
GLM · pwdz
Params313B
Context1024K
Smallest137.1 GB
ReasoningTool useVision
PH
Phi 3.1 mini 128k instruct
Phi · GPT4All-Community
Params3.82B
Context128K
Smallest2.2 GB
Coding
DI
Dimensity-3B
Dimensity · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
PH
parsak phi 2 code instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
CA
CapyberaHermesYi 34B ChatML 200K
Capyberahermesyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Tool use
BG
bge reranker large Q8 0
BGE · Astralyra
Params560M
Context512
Smallest0.6 GB
Embedding
LI
Ling Lite Base 1.5
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
ST
Stable DiffCoder 8B Instruct
Stable · mradermacher
Params8.25B
Context8K
Q4_K_M5.1 GB
Coding
QW
SvS Qwen Code 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
LaSER Qwen3 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
DE
RM R1 DeepSeek Distilled Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
TI
TinyBalls 110M V1
Tinyballs · mradermacher
Params113M
Context32K
Q4_K_M0.1 GB
ReasoningTool use
DE
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
DeepSeek · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
qwen2.5 coder
Qwen · cortexso
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
CE
Cecilia 2b Instruct v1
Cecilia · mradermacher
Params2.25B
Context8K
Q4_K_M1.5 GB
GGUF
LL
R1 1776 Distill Llama 70b Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use

Keep browsing