GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
BL
Blake XTM Arc 3B V1
Blake · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
ReasoningTool use
MI
Mini synata 7b 011 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
Synatra Kiqu 7B
Synatra · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Wiki
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
MI
maywell/PiVoT-10.7B-Mistral-v0.2
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
RE
ResplendentAI/Flora_DPO_7B
Resplendentai · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
syrian_qwen_3.5_4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
ST
StableLM-3b-EssayWriter
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
SH
sheared silicon10p
Sheared · mradermacher
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
MA
maywell kiqu 70b
Maywell · noopSD
Params69B
Context32K
Smallest14.5 GB
GGUF
DE
natural sql 7b
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
QW
qwen3 4b instruct 2507 travel it
Qwen · pockettravel
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
GP
gyaim-lm-small-public-v1
Gpt · tanabe1478
Params95M
Context1K
Smallest0.1 GB
GGUF
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
HU
Flexan HumanPet X2.2 1.7B
Humanpet · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
ming vintage qwen3b lora
Qwen · Beltran12138
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
qwen3 4b instruct 2507 travel en
Qwen · pockettravel
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
BA
T5 Base Japanese
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
MI
maywell/PiVoT-10.7B-Mistral-v0.2-RP
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
ST
stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
ST
Stabilityai Stablelm 3b 4e1t
Stablelm · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
Coding
RE
ResplendentAI Paradigm Shift 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kiqu 70b
Kiqu · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
WA
WaiJiaoAI Instruct V1.0 1.8B
Waijiaoai · anonymous-guest
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
JP
JPharmatron 7B Base
Jpharmatron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
JP
EQUES JPharmatron 7B
Jpharmatron · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
DE
natural sql 7b
DeepSeek · chatdb
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
SQ
sqlcoder 7b
Sqlcoder · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding

Keep browsing