GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
TO
TowerInstruct 7B v0.1
Towerinstruct · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
NO
Noromaid 20B v0.1.1
Noromaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
FI
Fimbulvetr 11B v2 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
DO
weyaxi_dolphin2.1-openorca-7b
Dolphin · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AT
Athnete 13B
Athnete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TI
Tiny Aya Global
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AN
sao10k_ana-v1-m7
Ana · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
LL
Llama 3 Meerkat 8b v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
KU
Kunokukulemonchini 7b
Kunokukulemonchini · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
WI
winter garden 7b alpha
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
BI
Bielik 7B Instruct v0.1
Bielik · speakleash
Params7.24B
Context4K
Q4_K_M4.4 GB
NO
Noromaid 13B 0.4 DPO i1
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB