GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuraLake m7 7B i1
Neuralake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Verdict DADA 8x7B i1
Verdict · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Eagle2-2B
Qwen · Mungert
Params1.78B
Context32K
Q4_K_M1.2 GB
Tool useVision
AL
AlphaMist7B Slr v2
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
loyal piano m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
Thespis CurtainCall 7b v0.3 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChatWaifu_2.0_vision
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplayVision
NE
NeuralMarcoro14 7B
Neuralmarcoro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
AceMath-7B-Instruct
Acemath · Mungert
Params7.62B
Context4K
Q4_K_M4.8 GB
GGUF
CY
CybersurferNyandroidLexicat 8x7B i1
Cybersurfernyandroidlexicat · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
nbeerbower Lyra Gutenberg mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FO
MN 12B FoxFrame Shinori i1
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
NeverSleep_Llama-3-Lumimaid-8B-v0.1
Llama · NeverSleep
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
ReMM v2.1 L2 13B i1
Remm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SI
Silicon-Alice-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Experiment v2 Qwen 3.5 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
EC
echidna tiefigther 25
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Hala 700M
Hala · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
Tool use
OG
Ogno Monarch Jaskier Merge 7b
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b R
Xlam · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
FI
Fimbulvetr Kuro Lotus 10.7B
Fimbulvetr · bartowski
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
NI
L3.1 8B Niitama v1.1 i1
Niitama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen1.5 7B Dutch Chat i1
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
CH
CheXOne
Chexone · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Reasoning
ME
Mental Alpaca
Mental · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
YU
YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong
Yue · botp
Params632M
Context—
Smallest0.0 GB
GGUF
AU
Audio8-TTS-Realistic-0.6b
Audio · cstr
Params939M
Context—
Smallest1.3 GB
GGUF
LU
Lumimaid v0.2 70B i1
Lumimaid · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing