GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
XL
xLAM 2 1b Fc R
Xlam · DevQuasar-13
Params1.54B
Context32K
Q4_K_M1.0 GB
DR
dragonwar 7b alpha
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenLLM Ro RoLlama3 8b Instruct
Openllm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
RoMistral 7b Instruct 2024 05 17 i1
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Merge-Mayhem-L3-V2.1
Merge · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
SOLAR 10.7B Merge Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama3.1 8b Instruct DPO
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
JI
Jina Embeddings v5 Text Small Retrieval
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
DU
DukunLM 7B V1.0 Uncensored
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
K2S3 Mistral 7b v1.47
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
UL
Ultron Summarizer 3B
Ultron · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
CH
ChatWaifu_22B_v2.0_preview
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
CO
E1 Code 14B
Code · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CO
CALM 8B i1
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
Daredevil 7B
Daredevil · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenLLM Ro RoMistral 7b Instruct 2024 05 17
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceAbsintheNeatRP 7b
Iceabsintheneatrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AC
nvidia.AceMath 7B Instruct
Acemath · DevQuasar-7
Params7.62B
Context4K
Q4_K_M4.7 GB
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
CR
Creative Writer 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
LL
Llama3.1 Aloe Beta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
BrokenKeyboard
Brokenkeyboard · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
OpenMia Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Relay v0.1 Mistral Nemo 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
AY
aya-23-35B
Aya · lmstudio-community
Params35B
Context8K
Q4_K_M21.5 GB