GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
MA
E1 Math 7B
Math · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LU
Lumimaid v0.2 12B
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Praxis Bookwriter Llama3.1 8b Sft
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
JE
Jellyfish 7B
Jellyfish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 7b Gpt4
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AR
Arsenic Shahrazad 12B v4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ML
MLewd v2.4 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
NE
Nethena MLewd Xwin 23B
Nethena · mradermacher
Params22.8B
Context4K
Q4_K_M14.0 GB
KU
Kuwutu 7B CYOA
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DU
DukunLM 7B V1.0 Uncensored sharded
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
XL
xLAM 2 32b Fc R
Xlam · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CO
CohereForAI.c4ai Command A 03 2025
Command R · DevQuasar
Params111B
Context16K
Q4_K_M67.1 GB
HO
Holo4 27B
Holo · abenzerps
Params26.9B
Context256K
Q4_K_M16.5 GB
LL
Suzume Llama 3 8B Multilingual
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
PsyCoPref Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IC
Ice0.101 20.03 RP i1
Icemedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ON
ONS SOLAR 10.7B v1.1
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
CO
CohereForAI.c4ai Command R7B Arabic 02 2025
Command R · DevQuasar-9
Params8.03B
Context16K
Q4_K_M5.1 GB
AI
Airoboros 33b Gpt4 1.2
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
AI
Airoboros 7b Gpt4 1.1
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VE
Verdict DADA 8x7B
Verdict · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
RI
Rivermind 24B v1
Rivermind · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
Seraph 7B
Seraph · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LB
LBonVent-12B
Lbonvent · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
saishf Ortho SOVL 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Aloe Beta 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama-3-Lumimaid-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
FO
MN 12B FoxFrame Miyuri i1
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB