GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralBeagle14-7B
Neuralbeagle · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MO
Most Embed De
Most · mradermacher
Params1.14B
Context256K
Q4_K_M0.7 GB
Embedding
RE
reader lm 1.5b i1
Reader · mradermacher
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
ME
Merge-Mayhem-L3-V2
Merge · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
TH
Thanos 8B
Thanos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CO
c4ai-command-r-v01
Command R · second-state
Params35B
Context128K
Q4_K_M21.5 GB
Coding
ST
Starling LM 7B alpha
Starling · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · NeverSleep
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
CoCo Decision 4B
Coco · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
CR
Creative Writer Plus 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · Dragnbrn
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
NY
Nyxene v3 11B i1
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
EH
EHR R1 8B
Ehr · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
TH
Thanos 1B i1
Thanos · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MI
BagelMIsteryTour v2 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
BE
Beyonder 4x7B v3 i1
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
IM
Juggernaut Z Image
Image · milo01
Params6.15B
Context—
Q4_K_M5.2 GB
GGUF
AY
Aya Medikal V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
RE
ResuVL L
Resuvl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
ST
Lodestar 4B
Startlux · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
AC
AceInstruct 1.5B
Aceinstruct · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
RI
Rivermind 12B v1 Heretic
Rivermind · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
kunoichi-lemon-royale-v2-32K-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
ReMM v2 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
command a 03 2025 writer v1 i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
GGUF
LL
Llama-3-LewdPlay-8B-evo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Oasis-v1-OAS-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
Euryale Inverted L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing