GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
OG
ogno monarch jaskier merge 7b v2
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DataVortexS 10.7B Dpo v1.4
Datavortexs · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
AI
Airoboros 33b Gpt4 1.4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
HO
Home 3B v2
Home · acon96
Params2.78B
Context2K
Q4_K_M1.7 GB
SO
SOLAR 10.7B v1.6
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
KU
kuno kunoichi v1 DPO v2 SLERP 7B
Kuno · grimjim
Params7.24B
Context8K
Q4_K_M4.4 GB
BA
baddy_S3_EXP_3
Baddy · MrDragonFox
Params3.3B
Context128K
Q4_K_M2.1 GB
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ST
L3 8B Stheno v3.2
Stheno · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
XL
xLAM 2 32b Fc R
Xlam · DevQuasar-14
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
recoilme gemma 2 9B v0.4 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
PA
paulml OmniBeagleSquaredMBX v3 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenOrca Zephyr 7B
Openorca · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Sao10K/L3-8B-Stheno-v3.2
Stheno · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.6 35B Zenith
Qwen · eggdog100
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Skadi Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AL
Alsebay/Narumashi-11B-v0.9
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
TO
Toppy M 7B
Toppy · Undi95
Params7.24B
Context32K
Smallest4.1 GB
HA
Hammer2.1 0.5b
Hammer · Melvin56
Params494M
Context32K
Q4_K_M0.4 GB
MU
Multi Verse RP 7B i1
Multi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Ayam 2x8B
Ayam · R136a1
Params13.7B
Context8K
Q4_K_M8.3 GB
OB
Obrolin Kesehatan 7B v0.1
Obrolin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 8x7b R
Xlam · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
LU
Lumimaid v0.2 8B Heretic
Lumimaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
TH
TherapyBeagle 11B v1
Therapybeagle · victunes
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
NeverSleep Llama 3 Lumimaid 70B v0.1 OAS
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
SH
NExtNewChattingAI/shark_tank_ai_7b_v2
Shark · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
L3-TenyxChat-Daybreak-Storywriter-RAE-70B
Tenyxchat · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
NeuraLake m7 v2 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB