GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
RW
rwitz2 go bruins v2.1
Rwitz · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
TowerBase 7B v0.1
Towerbase · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
SO
SOLAR 10.7B Instruct STOCK_SOLAR Ties
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
IC
icefog72/IceLatteRP-7b
Icelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
kukulemon v3 soul mix 32k 7B
Kukulemon · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kilo 2x8B
Kilo · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
LL
Llama 3 LewdPlay 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
Undi95 UtopiaXL 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PL
PLLuM 12B nc instruct 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
Caspi 1.7B
Caspi · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
QW
CscSQL Merge Qwen2.5 Coder 1.5B Instruct
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GE
gemma 2 9b HangulFixer
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
CA
Captain VioLyra v0.3 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AL
AlphaMonarch laser iMat
Alphamonarch · dranger003
Params7.24B
Context32K
Smallest3.2 GB
SO
macadeliccc/SOLAR-10.7b-Instruct-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
INFIndo Qwen3 32B Preview
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
IC
icefog72/IceLemonTeaRP-32k-7b
Icelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
LL
Llama3 Pirate Talk 8b v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
Rost 1b Instruct Hf
Rost · stefaniancu
Params1.38B
Context4K
Q4_K_M0.8 GB
RE
ReaderLM v2
Readerlm · DhruvalLabs
Params1.54B
Context501K
Q4_K_M1.0 GB
KI
Kilo 2x8B i1
Kilo · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
DA
DataVortexS 10.7B Dpo v1.3
Datavortexs · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
EC
Echidna 13b v0.2
Echidna · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
NO
NoromaidxOpenGPT4 1
Noromaidxopengpt · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
dmis-lab/llama-3-meerkat-8b-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BO
Borealis 10.7B DPO
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
LL
Edgerunners/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB