GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NE
NeuralBeagle14 7B
Neuralbeagle · mlabonne
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
jina reranker v2 base multilingual
Jina · cstr
Params278M
Context—
Smallest0.3 GB
EH
EHR R1 1.7B
Ehr · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ME
MedCrab 1.5B
Medcrab · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
MI
L3.1 70b Milasha i1
Milasha · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TH
L3 TheSpice 8b v0.1.3 i1
Thespice · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtral 13Bx2 MOE 22B
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
AI
Airoboros 7b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
recoilme gemma 2 9B v0.3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
badger writer llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AY
Aya Expanse 32b Heretic MPOA
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
NE
RA IT NER Zh 7B
Ner · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GE
Genie
Genie · mradermacher
Params7.24B
Context32K
Q4_K_M4.8 GB
FI
Kuro Lotus 10.7B
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
IN
QuixiAI Ina v11.1
Ina · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BL
alnrg2arg/blockchainlabs_7B_merged_test2_4_prune
Blockchainlabs · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Nemotron-Research-Reasoning-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ST
Strawberry_Smoothie 12B Model_Stock
Strawberry · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RE
reader lm 1.5b
Reader · DevQuasar-3
Params1.54B
Context250K
Q4_K_M1.0 GB
XL
xLAM 1b Fc R
Xlam · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
PS
Psyfighter2 Noromaid Ties Capybara 13B
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PH
Phainesthesia 8x7B
Phainesthesia · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MA
Machynlleth 3B Instruct
Machynlleth · mradermacher
Params2.67B
Context2K
Q4_K_M1.7 GB
KU
Kuwutu 7B CYOA v2
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LU
Luban Marcoroni 13B v3
Luban · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MO
Monomer 24b Preview E1
Monomer · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
TI
CohereLabs.tiny Aya Fire
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
QW
Qwen2.5 7B Instruct_Johnny_Silverhand_Merged
Qwen · lewiswatson
Params7.62B
Context32K
Q4_K_M4.7 GB
AL
AlphaMist7B Slr v1
Alphamist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB