GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
RW
rwitz2 go bruins v2.1
Rwitz · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
TowerBase 7B v0.1
Towerbase · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SO
SOLAR 10.7B Instruct STOCK_SOLAR Ties
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IC
icefog72/IceLatteRP-7b
Icelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
kukulemon v3 soul mix 32k 7B
Kukulemon · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kilo 2x8B
Kilo · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Roleplay
LL
Llama 3 LewdPlay 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UN
Undi95 UtopiaXL 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PL
PLLuM 12B nc instruct 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CA
Caspi 1.7B
Caspi · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
QW
CscSQL Merge Qwen2.5 Coder 1.5B Instruct
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
GE
gemma 2 9b HangulFixer
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
CA
Captain VioLyra v0.3 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
AL
AlphaMonarch laser iMat
Alphamonarch · dranger003
Params7.24B
Context32K
Smallest3.2 GB
GGUF
SO
macadeliccc/SOLAR-10.7b-Instruct-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
INFIndo Qwen3 32B Preview
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Tool use
IC
icefog72/IceLemonTeaRP-32k-7b
Icelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
LL
Llama3 Pirate Talk 8b v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
Rost 1b Instruct Hf
Rost · stefaniancu
Params1.38B
Context4K
Q4_K_M0.8 GB
GGUF
RE
ReaderLM v2
Readerlm · DhruvalLabs
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
KI
Kilo 2x8B i1
Kilo · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Roleplay
DA
DataVortexS 10.7B Dpo v1.3
Datavortexs · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
EC
Echidna 13b v0.2
Echidna · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
NoromaidxOpenGPT4 1
Noromaidxopengpt · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
dmis-lab/llama-3-meerkat-8b-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BO
Borealis 10.7B DPO
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
LL
Edgerunners/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing