GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OG
ogno monarch jaskier merge 7b v2
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.4
Datavortexs · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AI
Airoboros 33b Gpt4 1.4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
HO
Home 3B v2
Home · acon96
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SO
SOLAR 10.7B v1.6
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KU
kuno kunoichi v1 DPO v2 SLERP 7B
Kuno · grimjim
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
BA
baddy_S3_EXP_3
Baddy · MrDragonFox
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
ST
L3 8B Stheno v3.2
Stheno · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
XL
xLAM 2 32b Fc R
Xlam · DevQuasar-14
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GE
recoilme gemma 2 9B v0.4 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PA
paulml OmniBeagleSquaredMBX v3 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenOrca Zephyr 7B
Openorca · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Sao10K/L3-8B-Stheno-v3.2
Stheno · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.6 35B Zenith
Qwen · eggdog100
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
MI
Skadi Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AL
Alsebay/Narumashi-11B-v0.9
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
TO
Toppy M 7B
Toppy · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
HA
Hammer2.1 0.5b
Hammer · Melvin56
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
MU
Multi Verse RP 7B i1
Multi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
AY
Ayam 2x8B
Ayam · R136a1
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
OB
Obrolin Kesehatan 7B v0.1
Obrolin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 8x7b R
Xlam · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
LU
Lumimaid v0.2 8B Heretic
Lumimaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
TH
TherapyBeagle 11B v1
Therapybeagle · victunes
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
NeverSleep Llama 3 Lumimaid 70B v0.1 OAS
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SH
NExtNewChattingAI/shark_tank_ai_7b_v2
Shark · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
L3-TenyxChat-Daybreak-Storywriter-RAE-70B
Tenyxchat · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
NeuraLake m7 v2 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing