GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
TH
Thespis CurtainCall 7b v0.2.2 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chargoddard mixtralnt 4x7b test
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
AR
Arsenic Shahrazad 12B v3
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
NO
Noromaid 13B 0.4 DPO
Noromaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
indischepartij MiaLatte Indo Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
alnrg2arg test wanda 240109
Alnrg · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
AY
CohereForAI.aya Expanse 32b
Aya · DevQuasar-4
Params32.3B
Context8K
Q4_K_M19.8 GB
QW
isOCR-0.8B-alpha3
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
JE
Jellyfish 7B
Jellyfish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hala 700M
Hala · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
YU
yue2 3b
Yue · gguf-org
Params3.77B
Context—
Smallest2.3 GB
GE
chitonga chat run3
Gemma · zamai-zambia
Params7.46B
Context128K
Q4_K_M5.3 GB
MI
SFR Embedding Mistral
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
AppleSauce L2 13b
Applesauce · sauce1337
Params13B
Context4K
Smallest9.2 GB
NI
L3.1 8B Niitama v1.1
Niitama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
YU
Yue2-3B-GGUF
Yue · agosh
Params3.63B
Context—
Smallest0.3 GB
MI
Mixtral Instruct ITR DADA 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B KNUT ref
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NY
Nyxene v1 11B
Nyxene · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
JE
jevling 0.8b v0.1
Jevling · BricksDisplay
Params752M
Context256K
Q4_K_M0.5 GB
SM
Smegmma-Deluxe-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
KU
Beyonder-4x7B-v3
Kunoichi · bartowski
Params24.2B
Context32K
Q4_K_M14.6 GB
GL
glider
Glider · PatronusAI
Params3.82B
Context128K
Q4_K_M2.4 GB
SO
dddsaty/SOLAR_Merge_Adapter_DPO_Orca
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
CohereForAI.c4ai Command R 08 2024
Command R · DevQuasar-10
Params32.3B
Context128K
Q4_K_M19.8 GB
SO
saishf/SOVL-Mega-Mash-V2-L3-8B
Sovl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
saishf/SOVLish-Devil-8B-L3
Sovlish · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
Smegmma-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
ME
MedMitsu
Medmitsu · Himitsui
Params10.7B
Context4K
Smallest6.1 GB
ML
MLewd L2 13B v2 1
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB