GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
fibo2 edit turbo q4 0
Fibo · AbrahamPJ
Params8.23B
Context—
Smallest4.9 GB
GGUF
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
MN 12B Lyra v2a1 i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AM
U Amethyst 20B i1
Amethyst · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
HE
Hemmingway 1 Heretic
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool use
TH
L3 TheGreenLion 8b Experimental
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OP
OpenJev Flash 9B
Openjev · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
SO
SOLAR 10.7B Instruct v1.0 128k iMat
Solar · cgus
Params10.7B
Context128K
Q4_K_M6.5 GB
GGUF
JI
Jina Embeddings v3
Jina · second-state
Params558M
Context8K
Q4_K_M0.4 GB
CodingEmbedding
TE
Teuken 7B Instruct v0.6
Teuken · mradermacher
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
DA
DanTagGen gamma
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GGUF
CA
Camel Platypus2 70B i1
Camel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ML
MLewd v2.4 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct i1
Sauerkrautlm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AR
Ara Jev Faisal
Ara · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingReasoningTool use
IC
Ice0.17 03.10 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
XL
xLAM 8x7b R
Xlam · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
RE
reader lm 0.5b
Reader · QuantFactory
Params630M
Context250K
Q4_K_M0.5 GB
GGUF
FL
FlatOrcamaid 13B v0.2
Flatorcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GU
GutenOCR 7B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
HY
Hyou 2x7B
Hyou · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
Roleplay
MI
Mistral 7B claude instruct i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Refueled
Llama · thesven
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IA
Iambe RP cDPO 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
CO
c4ai-command-r-v01
Command R · lmstudio-community
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
SA
Sansar Ocr 2b
Sansar · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MA
Maestrale Chat v0.3 Beta
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing