GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
DU
DukunLM 13B V1.0 Uncensored sharded i1
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
BA
MN BackyardAI Party 12B v1
Backyardai · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TO
TowerBase 7B v0.1
Towerbase · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AC
AceMath 7B Instruct
Acemath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
NY
beberik_nyxene-v3-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Mistral 7B claude chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GA
Gadsby 4B
Gadsby · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
JI
jina embeddings v5 omni nano text matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · bartowski
Params8B
Context1048K
Q4_K_M4.9 GB
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
SP
Spaetzle v85 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
LemonadeRP 4.5.3
Noromaid · TheBigBlender
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
jina embeddings v5 omni small clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
NO
Noromaid 13B 0.4 DPO
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ES
MN 12B Estrella v1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RO
RoMistral 7b Instruct 2025 04 23
Romistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CH
ChocoLlama 2 7B instruct
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
RO
RoLlama2 7b Instruct 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Nemotron Research Reasoning Qwen 1.5B v2 RLVE
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
mistral ft optimized 1218
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Marcoroni 13B
Marcoroni · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
UL
Ultra Instruct 12B i1
Ultra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GM
GME VARCO VISION Embedding i1
Gme · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
E1 Code 14B
Code · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
XL
xLAM 1b fc r
Xlam · Salesforce
Params1.35B
Context16K
Q4_K_M0.9 GB