GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
FI
fibo2 edit turbo q4 0
Fibo · AbrahamPJ
Params8.23B
Context—
Smallest4.9 GB
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
MN 12B Lyra v2a1 i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AM
U Amethyst 20B i1
Amethyst · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
HE
Hemmingway 1 Heretic
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TH
L3 TheGreenLion 8b Experimental
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
OpenJev Flash 9B
Openjev · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
SO
SOLAR 10.7B Instruct v1.0 128k iMat
Solar · cgus
Params10.7B
Context128K
Q4_K_M6.5 GB
JI
Jina Embeddings v3
Jina · second-state
Params558M
Context8K
Q4_K_M0.4 GB
TE
Teuken 7B Instruct v0.6
Teuken · mradermacher
Params7.45B
Context4K
Q4_K_M5.0 GB
DA
DanTagGen gamma
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
CA
Camel Platypus2 70B i1
Camel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ML
MLewd v2.4 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SauerkrautLM UNA SOLAR Instruct i1
Sauerkrautlm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AR
Ara Jev Faisal
Ara · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
IC
Ice0.17 03.10 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 8x7b R
Xlam · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
RE
reader lm 0.5b
Reader · QuantFactory
Params630M
Context250K
Q4_K_M0.5 GB
FL
FlatOrcamaid 13B v0.2
Flatorcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GU
GutenOCR 7B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
HY
Hyou 2x7B
Hyou · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
MI
Mistral 7B claude instruct i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Refueled
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
IA
Iambe RP cDPO 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CO
c4ai-command-r-v01
Command R · lmstudio-community
Params35B
Context128K
Q4_K_M21.5 GB
SA
Sansar Ocr 2b
Sansar · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
MA
Maestrale Chat v0.3 Beta
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB