GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
EN
Envoid L3 TenyxChat Daybreak Storywriter RAE 70B
Envoid · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GR
grimjim kuno kunoichi v1 DPO v2 SLERP 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10.7B Sft Dpo v1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MA
macadeliccc SOLAR math 2x10.7b v0.2
Macadeliccc · RichardErkhov
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct-v1.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UR
Urllm Ko 7b
Urllm · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
KI
ReMM v2 Kimiko v2 13B
Kimi · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NeuralOmniWestBeaglake 7B
Neuralomniwestbeaglake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
sraka 27b experimental
Qwen · texdata
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
IC
Ice0.40 20.11 RP i1
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
JI
jina embeddings v5 text nano retrieval Q8A64
Jina · VelociQ8
Params322M
Context8K
Smallest0.3 GB
GGUF
QW
Qwen2 7B Ko Instruct Orpo Ver_2.0_Wo_Chat
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
FB
fblgit LUNA SOLARkrautLM Instruct
Fblgit · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
RO
RoLlama2-7b-Instruct
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
XL
xLAM 7b R
Xlam · DevQuasar-5
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AY
aya-23-8B
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Undi95 Xwin MLewd 13B V0.2
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XG
Salesforce xgen small 9B instruct r
Xgen · ArtusDev
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
NoromaidxOpenGPT4 1 i1
Noromaidxopengpt · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
K2S3 Mistral 7b v1.1
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4.1
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OX
OxytocinErosEngineeringFX 7B slerp
Oxytocinerosengineeringfx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
Beyonder 4x7B v3 random lora i1
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CO
code embed v2
Code · divakantpandey
Params125M
Context1K
Smallest0.1 GB
CodingEmbedding
PS
Psyfighter2 Noromaid Ties 13B
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
winter garden 7b gamma i1
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing