GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
Thespis CurtainCall 7b v0.2.2 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
chargoddard mixtralnt 4x7b test
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
AR
Arsenic Shahrazad 12B v3
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
NO
Noromaid 13B 0.4 DPO
Noromaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
indischepartij MiaLatte Indo Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
alnrg2arg test wanda 240109
Alnrg · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AY
CohereForAI.aya Expanse 32b
Aya · DevQuasar-4
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
QW
isOCR-0.8B-alpha3
Qwen · carlesonielfa
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
JE
Jellyfish 7B
Jellyfish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Hala 700M
Hala · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
Tool use
YU
yue2 3b
Yue · gguf-org
Params3.77B
Context—
Smallest2.3 GB
GGUF
GE
chitonga chat run3
Gemma · zamai-zambia
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
MI
SFR Embedding Mistral
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
AP
AppleSauce L2 13b
Applesauce · sauce1337
Params13B
Context4K
Smallest9.2 GB
GGUF
NI
L3.1 8B Niitama v1.1
Niitama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
YU
Yue2-3B-GGUF
Yue · agosh
Params3.63B
Context—
Smallest0.3 GB
GGUF
MI
Mixtral Instruct ITR DADA 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B KNUT ref
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NY
Nyxene v1 11B
Nyxene · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
JE
jevling 0.8b v0.1
Jevling · BricksDisplay
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
SM
Smegmma-Deluxe-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KU
Beyonder-4x7B-v3
Kunoichi · bartowski
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
GL
glider
Glider · PatronusAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
SO
dddsaty/SOLAR_Merge_Adapter_DPO_Orca
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CO
CohereForAI.c4ai Command R 08 2024
Command R · DevQuasar-10
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
SO
saishf/SOVL-Mega-Mash-V2-L3-8B
Sovl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
saishf/SOVLish-Devil-8B-L3
Sovlish · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SM
Smegmma-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ME
MedMitsu
Medmitsu · Himitsui
Params10.7B
Context4K
Smallest6.1 GB
GGUF
ML
MLewd L2 13B v2 1
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF

Keep browsing