GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
Lumimaid 8B v0.1 OAS Q5 K S GGUF iMatrix
Lumimaid · Clevyby
Params8.03B
Context8K
Smallest5.6 GB
Roleplay
GH
ghana voice nzema
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
QW
bhai qwen35 4b lora
Qwen · BultenHub
Params21M
Context—
Smallest0.0 GB
GGUF
JE
Jellyfish-8B
Jellyfish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
MarsupialAI SkunkApe 14b
Marsupialai · RichardErkhov
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
IC
Ice0.37 18.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NE
Nemo12b TheSyntheticOne
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
AM
U Amethyst 20B
Amethyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
OR
Orthrus 12b v0.8
Orthrus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ER
OxytocinErosEngineeringF1 7B slerp
Eris · weezywitasneezy
Params7.24B
Context32K
Smallest14.5 GB
GGUF
AY
aya-23-35B
Aya · backyardai
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
13
1.3b i1
mradermacher
Params1.32B
Context2K
Q4_K_M0.9 GB
GGUF
AC
Salesforce.E1 AceReason 14B
Acereason · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GP
FlashTopic Gpt Oss 20b Qat 0924 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GH
ghana voice bimoba
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
IC
Ice0.31 08.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
TH
Thespis CurtainCall 7b v0.2.2
Thespis · cgato
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR-10.7B-NahIdWin
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GP
Gpt2 Xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
NY
L3-Nymeria-v2-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SO
L3-Solana-8B-v1
Solana · insomniactools
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MU
musicgen large
Musicgen · vokra
Params3.26B
Context—
Smallest6.5 GB
GGUF
ML
mlabonne UltraMerge 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
dnotitia.Llama DNA 1.0 8B Instruct
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AI
AIFT Yi Ko 6B v1.11
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
SH
Shreyansh STEM AI 2B v3
Shreyansh · mradermacher
Params1.89B
Context4K
Q4_K_M1.2 GB
GGUF
LL
Akash Ai 70B v0.1
Llama · MRSHREY197
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
JI
Jina Embeddings v5 Text Small Text Matching
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
LU
NeverSleep/Lumimaid-v0.2-8B
Lumimaid · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing