GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DU
DukunLM 13B V1.0 Uncensored sharded i1
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BA
MN BackyardAI Party 12B v1
Backyardai · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TO
TowerBase 7B v0.1
Towerbase · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AC
AceMath 7B Instruct
Acemath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
NY
beberik_nyxene-v3-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
MI
Mistral 7B claude chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GA
Gadsby 4B
Gadsby · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
JI
jina embeddings v5 omni nano text matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingReasoningTool use
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
SP
Spaetzle v85 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
LemonadeRP 4.5.3
Noromaid · TheBigBlender
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
jina embeddings v5 omni small clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
NO
Noromaid 13B 0.4 DPO
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ES
MN 12B Estrella v1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RO
RoMistral 7b Instruct 2025 04 23
Romistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Reasoning
CH
ChocoLlama 2 7B instruct
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RO
RoLlama2 7b Instruct 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
QW
Nemotron Research Reasoning Qwen 1.5B v2 RLVE
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
MI
mistral ft optimized 1218
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Marcoroni 13B
Marcoroni · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
UL
Ultra Instruct 12B i1
Ultra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GM
GME VARCO VISION Embedding i1
Gme · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
EmbeddingVision
CO
E1 Code 14B
Code · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
XL
xLAM 1b fc r
Xlam · Salesforce
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use

Keep browsing