GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralBeagle14 7B
Neuralbeagle · mlabonne
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
jina reranker v2 base multilingual
Jina · cstr
Params278M
Context—
Smallest0.3 GB
GGUF
EH
EHR R1 1.7B
Ehr · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
ME
MedCrab 1.5B
Medcrab · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
MI
L3.1 70b Milasha i1
Milasha · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TH
L3 TheSpice 8b v0.1.3 i1
Thespice · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mixtral 13Bx2 MOE 22B
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
AI
Airoboros 7b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GE
recoilme gemma 2 9B v0.3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
badger writer llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
Aya Expanse 32b Heretic MPOA
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
NE
RA IT NER Zh 7B
Ner · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
GE
Genie
Genie · mradermacher
Params7.24B
Context32K
Q4_K_M4.8 GB
GGUF
FI
Kuro Lotus 10.7B
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
QuixiAI Ina v11.1
Ina · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
BL
alnrg2arg/blockchainlabs_7B_merged_test2_4_prune
Blockchainlabs · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Nemotron-Research-Reasoning-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
ST
Strawberry_Smoothie 12B Model_Stock
Strawberry · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RE
reader lm 1.5b
Reader · DevQuasar-3
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
XL
xLAM 1b Fc R
Xlam · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
PS
Psyfighter2 Noromaid Ties Capybara 13B
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phainesthesia 8x7B
Phainesthesia · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MA
Machynlleth 3B Instruct
Machynlleth · mradermacher
Params2.67B
Context2K
Q4_K_M1.7 GB
GGUF
KU
Kuwutu 7B CYOA v2
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
LU
Luban Marcoroni 13B v3
Luban · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Monomer 24b Preview E1
Monomer · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
TI
CohereLabs.tiny Aya Fire
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
QW
Qwen2.5 7B Instruct_Johnny_Silverhand_Merged
Qwen · lewiswatson
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AL
AlphaMist7B Slr v1
Alphamist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing