GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
XL
xLAM 2 1b Fc R
Xlam · DevQuasar-13
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
DR
dragonwar 7b alpha
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenLLM Ro RoLlama3 8b Instruct
Openllm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
RoMistral 7b Instruct 2024 05 17 i1
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Merge-Mayhem-L3-V2.1
Merge · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR 10.7B Merge Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoLlama3.1 8b Instruct DPO
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
JI
Jina Embeddings v5 Text Small Retrieval
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
DU
DukunLM 7B V1.0 Uncensored
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
K2S3 Mistral 7b v1.47
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
UL
Ultron Summarizer 3B
Ultron · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
CH
ChatWaifu_22B_v2.0_preview
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
ReasoningRoleplay
CO
E1 Code 14B
Code · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
CO
CALM 8B i1
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DA
Daredevil 7B
Daredevil · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
OP
OpenLLM Ro RoMistral 7b Instruct 2024 05 17
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceAbsintheNeatRP 7b
Iceabsintheneatrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
nvidia.AceMath 7B Instruct
Acemath · DevQuasar-7
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
CR
Creative Writer 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
LL
Llama3.1 Aloe Beta 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BR
BrokenKeyboard
Brokenkeyboard · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
OpenMia Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Relay v0.1 Mistral Nemo 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
AY
aya-23-35B
Aya · lmstudio-community
Params35B
Context8K
Q4_K_M21.5 GB
GGUF

Keep browsing