GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
TO
TowerInstruct 7B v0.1
Towerinstruct · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Noromaid 20B v0.1.1
Noromaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
FI
Fimbulvetr 11B v2 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool use
DO
weyaxi_dolphin2.1-openorca-7b
Dolphin · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Athnete 13B
Athnete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
Tiny Aya Global
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
LL
Llama 3.1 8B Stheno v3.4
Llama · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
GGUF
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AN
sao10k_ana-v1-m7
Ana · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Llama 3 Meerkat 8b v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunokukulemonchini 7b
Kunokukulemonchini · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
WI
winter garden 7b alpha
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
BI
Bielik 7B Instruct v0.1
Bielik · speakleash
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
NO
Noromaid 13B 0.4 DPO i1
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing