GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
Unholy-v2-13B
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Arsenic Shahrazad 12B v4.4.1 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
AR
Arsenic Shahrazad 12B v4.4.2 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
XL
Salesforce.xLAM 8x22b R
Xlam · DevQuasar-4
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
RO
RoLlama2 7b Instruct 2024 10 09
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
IC
IceCocoaRP-7b
Icecocoarp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
OGNO 7B
Parrotmathogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoMistral 7b Instruct 2024 10 09
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OrcaHermes Mistral 70B miqu
Mistral · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
Tool use
RO
RoGemma2 9b Instruct
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Reasoning
IO
Ionic2 4x8
Ionic · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
TH
cgato/L3-TheSpice-8b-v0.1.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Dionysus Mistral M3 v6
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Hanames 90B L3.1
Hanames · mradermacher
Params91.9B
Context128K
Smallest19.8 GB
GGUF
NO
Noromaid 7b v0.2 i1
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NeuralOmniBeagleMBX v3 7B
Neuralomnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Nephilim v3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EC
echidna tiefigther 25
Echidna · Henk717
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TO
Top Western Maid 7B
Top · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KU
Kunoichi Lemon Royale V2Experiment1 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
BR
Brunhilde 13b v3
Brunhilde · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IC
IceWhiskeyRP 7b
Icewhiskeyrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
LL
Envoid/L3.1-8B-Llamoutcast
Llamoutcast · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TI
Tiny Moe
Tiny · mradermacher
Params148M
Context2K
Q4_K_M0.1 GB
GGUF
JE
JerseyDevil 14b
Jerseydevil · mradermacher
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
NA
Narumashi 11B v0.9
Narumashi · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
HO
Hcompany.Holo4 27B
Holo · DevQuasar
Params26.9B
Context256K
Smallest10.7 GB
ReasoningTool useVision
MI
Mixtral 11Bx2 MoE 19B
Mistral · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF

Keep browsing