GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Context Obedient RAG
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
ST
Stablelm 3b 4e1t
Stablelm · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
BL
Blake XTM Arc T0
Blake · Flexan
Params7.24B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
NI
NipponNative
Nipponnative · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OP
open-calm-7b
Open · mmnga
Params6.87B
Context2K
Q4_K_M4.4 GB
GGUF
IS
Islamspecialist 7B
Islamspecialist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EP
Epstein
Epstein · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
Synatra 7B v0.3 Translation
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Main
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
MA
Marx-3B-V3_safetensors
Marx · RachidAR
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
VD
VDC Agent 7B
Vdc · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
SQ
defog.sqlcoder 7b 2
Sqlcoder · DevQuasar-13
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
PH
Blake XTM Arc 3B V1
Phi · Flexan
Params2.78B
Context2K
Q4_K_M1.7 GB
ReasoningTool use
FU
FuckYou 1.0
Fuckyou · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
NI
NipponNative
Nipponnative · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Genmai 310M
Genmai · miyaoka
Params310M
Context1K
Smallest0.3 GB
GGUF
HE
Helium 1 2b Stem
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
PA
orukeet-gabor-half.q8_0
Parakeet · aoiandroid
Params627M
Context—
Smallest0.7 GB
GGUF
HU
HumanPet X2.2 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
AI
airoboros-3b-3p0
Airoboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
SY
Synatra 7B v0.3 Translation
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
Sequential_Helium_6B
Sequential · mradermacher
Params6.3B
Context4K
Q4_K_M3.8 GB
GGUF
OP
open-calm-1b
Open · mmnga
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
SQ
sqlcoder 7b
Sqlcoder · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
HE
Helium 1 2b Science
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
AL
Alpona 1.0 9B
Alpona · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
BL
Flexan Blake Haiku 1
Blake · Flexan
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
OU
CiSiMi v0.1
Outetts · KandirResearch
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
LL
DR TEXT2SQL CodeLlama2 7B
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing