GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
UN
Unholy-v2-13B
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Lumimaid-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
Arsenic Shahrazad 12B v4.4.1 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AR
Arsenic Shahrazad 12B v4.4.2 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
XL
Salesforce.xLAM 8x22b R
Xlam · DevQuasar-4
Params141B
Context64K
Q4_K_M85.6 GB
RO
RoLlama2 7b Instruct 2024 10 09
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
IC
IceCocoaRP-7b
Icecocoarp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
OGNO 7B
Parrotmathogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoMistral 7b Instruct 2024 10 09
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OrcaHermes Mistral 70B miqu
Mistral · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
RO
RoGemma2 9b Instruct
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
IO
Ionic2 4x8
Ionic · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
TH
cgato/L3-TheSpice-8b-v0.1.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Dionysus Mistral M3 v6
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hanames 90B L3.1
Hanames · mradermacher
Params91.9B
Context128K
Smallest19.8 GB
NO
Noromaid 7b v0.2 i1
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NeuralOmniBeagleMBX v3 7B
Neuralomnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Nephilim v3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
EC
echidna tiefigther 25
Echidna · Henk717
Params13B
Context4K
Q4_K_M7.9 GB
TO
Top Western Maid 7B
Top · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
KU
Kunoichi Lemon Royale V2Experiment1 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
BR
Brunhilde 13b v3
Brunhilde · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
IC
IceWhiskeyRP 7b
Icewhiskeyrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
LL
Envoid/L3.1-8B-Llamoutcast
Llamoutcast · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
Tiny Moe
Tiny · mradermacher
Params148M
Context2K
Q4_K_M0.1 GB
JE
JerseyDevil 14b
Jerseydevil · mradermacher
Params14.2B
Context8K
Q4_K_M8.6 GB
NA
Narumashi 11B v0.9
Narumashi · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
HO
Hcompany.Holo4 27B
Holo · DevQuasar
Params26.9B
Context256K
Smallest10.7 GB
MI
Mixtral 11Bx2 MoE 19B
Mistral · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB