GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
E1 Math 7B
Math · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LU
Lumimaid v0.2 12B
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Praxis Bookwriter Llama3.1 8b Sft
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
Tool use
JE
Jellyfish 7B
Jellyfish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 7b Gpt4
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AR
Arsenic Shahrazad 12B v4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ML
MLewd v2.4 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
NE
Nethena MLewd Xwin 23B
Nethena · mradermacher
Params22.8B
Context4K
Q4_K_M14.0 GB
GGUF
KU
Kuwutu 7B CYOA
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DU
DukunLM 7B V1.0 Uncensored sharded
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
XL
xLAM 2 32b Fc R
Xlam · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
CO
CohereForAI.c4ai Command A 03 2025
Command R · DevQuasar
Params111B
Context16K
Q4_K_M67.1 GB
Tool use
HO
Holo4 27B
Holo · abenzerps
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
LL
Suzume Llama 3 8B Multilingual
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
PsyCoPref Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IC
Ice0.101 20.03 RP i1
Icemedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
ON
ONS SOLAR 10.7B v1.1
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
CO
CohereForAI.c4ai Command R7B Arabic 02 2025
Command R · DevQuasar-9
Params8.03B
Context16K
Q4_K_M5.1 GB
Tool use
AI
Airoboros 33b Gpt4 1.2
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AI
Airoboros 7b Gpt4 1.1
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VE
Verdict DADA 8x7B
Verdict · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
RI
Rivermind 24B v1
Rivermind · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
SE
Seraph 7B
Seraph · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LB
LBonVent-12B
Lbonvent · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
saishf Ortho SOVL 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Aloe Beta 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
Llama-3-Lumimaid-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
FO
MN 12B FoxFrame Miyuri i1
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing