GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
PH
Phi 3 Context Obedient RAG
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
ST
Stablelm 3b 4e1t
Stablelm · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
BL
Blake XTM Arc T0
Blake · Flexan
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
NipponNative
Nipponnative · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
open-calm-7b
Open · mmnga
Params6.87B
Context2K
Q4_K_M4.4 GB
IS
Islamspecialist 7B
Islamspecialist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EP
Epstein
Epstein · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SY
Synatra 7B v0.3 Translation
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Main
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
MA
Marx-3B-V3_safetensors
Marx · RachidAR
Params2.8B
Context4K
Q4_K_M1.7 GB
VD
VDC Agent 7B
Vdc · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
SQ
defog.sqlcoder 7b 2
Sqlcoder · DevQuasar-13
Params6.74B
Context16K
Q4_K_M4.1 GB
PH
Blake XTM Arc 3B V1
Phi · Flexan
Params2.78B
Context2K
Q4_K_M1.7 GB
FU
FuckYou 1.0
Fuckyou · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
NI
NipponNative
Nipponnative · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Genmai 310M
Genmai · miyaoka
Params310M
Context1K
Smallest0.3 GB
HE
Helium 1 2b Stem
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
PA
orukeet-gabor-half.q8_0
Parakeet · aoiandroid
Params627M
Context—
Smallest0.7 GB
HU
HumanPet X2.2 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
AI
airoboros-3b-3p0
Airoboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
SY
Synatra 7B v0.3 Translation
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Sequential_Helium_6B
Sequential · mradermacher
Params6.3B
Context4K
Q4_K_M3.8 GB
OP
open-calm-1b
Open · mmnga
Params1.42B
Context2K
Q4_K_M0.9 GB
SQ
sqlcoder 7b
Sqlcoder · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Science
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
AL
Alpona 1.0 9B
Alpona · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
BL
Flexan Blake Haiku 1
Blake · Flexan
Params596M
Context40K
Q4_K_M0.4 GB
OU
CiSiMi v0.1
Outetts · KandirResearch
Params499M
Context32K
Q4_K_M0.4 GB
LL
DR TEXT2SQL CodeLlama2 7B
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB