GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Kyutai.Helium 1 2b Stem
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
BL
Blake XTM Arc
Blake · Flexan
Params7.24B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
HE
Helium 1 2b Wiki
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
UN
L3.3 70B Unrestricted intelligence i1
Unrestricted · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
Helium 1 2b Books
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
PA
PaddleOCR VL 1.6 Bangla
Paddleocr · hasanmdsadadul
Params6M
Context—
Smallest0.0 GB
GGUF
ST
stablelm-3b-4e1t
Stablelm · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
BL
Blake XTM Arc 3B V1
Blake · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
ReasoningTool use
OP
open-calm-3b
Open · mmnga
Params2.79B
Context2K
Q4_K_M1.8 GB
GGUF
IS
Islamspecialist PRO 12B
Islamspecialist · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
AS
Astrohermes-3B
Astrohermes · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
QW
Flexan FoxyzGPT X1.1 1.7B
Qwen · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MI
minirecord_mini_synatra_7b_02
Mini · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chinna
Chinna · dubspai
Params40M
Context1K
Smallest0.1 GB
GGUF
AE
L3 Aethora 15B V2
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
QW
qwen3.5 0.8b travel it
Qwen · pockettravel
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
JU
juke 1.7b dev
Juke · asharrm
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
HE
Helium 1 2b Life
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
AK
Akins 3B
Akins · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
haryra 7b mistral id i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UE
ueban 1.3
Ueban · RaspizdAI
Params180M
Context1K
Q4_K_M0.1 GB
GGUF
QW
qwen3.5 2b travel it
Qwen · pockettravel
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
AI
Airoboros 3b 3p0
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
HU
Flexan HumanPet X1 1.7B
Humanpet · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MA
Marx 3B V3
Marx · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
SQ
sqlcoder 7b 2
Sqlcoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
BL
Blake XTM Arc
Blake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
EE
EEVE Math 10.8B i1
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF

Keep browsing