GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
GemmaECG Vision
Gemma · yasserrmd
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
NE
OpenMath Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
SM
smol bruin 7b
Smol · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MermaidMistral
Mermaidmistraldpo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
TableLLM DeepseekCoder 7B
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
HA
hammer2.0 7b
Hammer · neopolita
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow2
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Mermaid PythonCoder
Mermaid · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Coding
PH
Stoicism1 Phi3.5 mini instruct i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
EU
euclaise Memphis scribe 3B alpha
Euclaise · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HA
Haruhi Zero 7B 0_3
Haruhi · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
CH
MN Chunky Lotus 12B
Chunky · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
GP
Codegpt Oss 20b
gpt-oss · anon-researcher-ua
Params20.9B
Context128K
Q4_K_M15.8 GB
CodingReasoningTool use
QW
Qwen2.5 1.5B ArtCode
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
KM
kmynas pipiras
Kmynas · DeimantasLT
Params637M
Context—
Smallest0.7 GB
GGUF
LL
.\Mermaid\
Llama · mradermacher
Params5.41B
Context8K
Q4_K_M3.4 GB
GGUF
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
OpenReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
PI
pianissimo sv
Pianissimo · KlangAI
Params627M
Context—
Q4_K_M0.5 GB
GGUF
AF
AfriqueQwen3.5 4B 50Langs Instruct 20260917
Afriqueqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
SO
Sonya 7B GGUF IQ Imatrix
Sonya · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
BI
SikuRoBERTa_Bronze
Bird · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
AF
AfriqueQwen3.5 0.8B 50Langs
Afriqueqwen · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
GE
D:\Gemma_audio\models\indicconformer_patched.nemo
Gemma · Singla0009
Params129M
Context—
Smallest0.2 GB
GGUF
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
OC
Occam 2B CCoT
Occam · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
CH
FallenMerick/Chunky-Lemon-Cookie-11B
Chunky · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MO
Mobile ReasoningLLM v0
Mobile · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoning
BI
BioMistral v0.2
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing