GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
HE
Kyutai.Helium 1 2b Stem
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
BL
Blake XTM Arc
Blake · Flexan
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Wiki
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
UN
L3.3 70B Unrestricted intelligence i1
Unrestricted · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Helium 1 2b Books
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
PA
PaddleOCR VL 1.6 Bangla
Paddleocr · hasanmdsadadul
Params6M
Context—
Smallest0.0 GB
ST
stablelm-3b-4e1t
Stablelm · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
BL
Blake XTM Arc 3B V1
Blake · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
OP
open-calm-3b
Open · mmnga
Params2.79B
Context2K
Q4_K_M1.8 GB
IS
Islamspecialist PRO 12B
Islamspecialist · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
AS
Astrohermes-3B
Astrohermes · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Flexan FoxyzGPT X1.1 1.7B
Qwen · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
MI
minirecord_mini_synatra_7b_02
Mini · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chinna
Chinna · dubspai
Params40M
Context1K
Smallest0.1 GB
AE
L3 Aethora 15B V2
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
QW
qwen3.5 0.8b travel it
Qwen · pockettravel
Params752M
Context256K
Q4_K_M0.5 GB
JU
juke 1.7b dev
Juke · asharrm
Params1.72B
Context40K
Q4_K_M1.1 GB
HE
Helium 1 2b Life
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
AK
Akins 3B
Akins · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
haryra 7b mistral id i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UE
ueban 1.3
Ueban · RaspizdAI
Params180M
Context1K
Q4_K_M0.1 GB
QW
qwen3.5 2b travel it
Qwen · pockettravel
Params1.88B
Context256K
Q4_K_M1.3 GB
AI
Airoboros 3b 3p0
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
HU
Flexan HumanPet X1 1.7B
Humanpet · Flexan
Params1.72B
Context40K
Q4_K_M1.1 GB
MA
Marx 3B V3
Marx · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
SQ
sqlcoder 7b 2
Sqlcoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
BL
Blake XTM Arc
Blake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EE
EEVE Math 10.8B i1
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB