GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
BL
Blake XTM Arc 3B V1
Blake · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
Mini synata 7b 011 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SY
Synatra Kiqu 7B
Synatra · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
HE
Helium 1 2b Wiki
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
MI
maywell/PiVoT-10.7B-Mistral-v0.2
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
RE
ResplendentAI/Flora_DPO_7B
Resplendentai · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
syrian_qwen_3.5_4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ST
StableLM-3b-EssayWriter
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
SH
sheared silicon10p
Sheared · mradermacher
Params2.7B
Context4K
Q4_K_M1.6 GB
MA
maywell kiqu 70b
Maywell · noopSD
Params69B
Context32K
Smallest14.5 GB
DE
natural sql 7b
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
qwen3 4b instruct 2507 travel it
Qwen · pockettravel
Params4.02B
Context256K
Q4_K_M2.5 GB
GP
gyaim-lm-small-public-v1
Gpt · tanabe1478
Params95M
Context1K
Smallest0.1 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
HU
Flexan HumanPet X2.2 1.7B
Humanpet · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
ming vintage qwen3b lora
Qwen · Beltran12138
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
qwen3 4b instruct 2507 travel en
Qwen · pockettravel
Params4.02B
Context256K
Q4_K_M2.5 GB
BA
T5 Base Japanese
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
MI
maywell/PiVoT-10.7B-Mistral-v0.2-RP
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
ST
stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
ST
Stabilityai Stablelm 3b 4e1t
Stablelm · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
RE
ResplendentAI Paradigm Shift 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kiqu 70b
Kiqu · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
WA
WaiJiaoAI Instruct V1.0 1.8B
Waijiaoai · anonymous-guest
Params1.84B
Context32K
Q4_K_M1.2 GB
JP
JPharmatron 7B Base
Jpharmatron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
JP
EQUES JPharmatron 7B
Jpharmatron · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
DE
natural sql 7b
DeepSeek · chatdb
Params6.91B
Context4K
Q4_K_M4.2 GB
SQ
sqlcoder 7b
Sqlcoder · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB