GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SP
Spaetzle v60 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
Lyra4 Gutenberg2 12B
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SU
SunnyRain 2x10.7B
Sunnyrain · mradermacher
Params19.2B
Context4K
Q4_K_M11.7 GB
GGUF
PI
PiVoT MoE
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GGUF
JE
Jeff 1.0 Large
Jeff · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
LI
OmniLing V1 8b experimental
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
shamrock 0 e2b
Gemma · oxalis-ink
Params4.63B
Context128K
Q4_K_M3.4 GB
Vision
JI
jina embeddings v5 omni small text matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · backyardai
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
ML
MLewd L2 Chat 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
SHRDFU 7b gamma
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
OX
Oxide F1 7B slerp
Oxide · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool useVision
MI
MixtralOrochi8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
Llama3.1_StoryGeneration
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
EX
Explore LM Ext 7B Math
Explore · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VY
VyvoTTS LFM2 350M Jenny
Vyvotts · mradermacher
Params383M
Context125K
Q4_K_M0.3 GB
Tool use
AM
AmhQA_Multitask Small
Amhqa · mradermacher
Params300M
Context512
Q4_K_M0.2 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · oncu
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3 8B Instruct DADA iMat
Llama · Quant-Cartel
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
AI
Airoboros 65b Gpt4 1.4
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
Tool use
CO
C4Ai Command R7B Arabic 02 2025
Command R · matrixportalx
Params8.03B
Context16K
Q4_K_M5.1 GB
Tool use
EU
L3.1 70B Euryale v2.2
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OP
OpenHermes 2.5 Nebula v2 7B
Openhermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DE
Dendrite-L3-10B
Dendrite · mradermacher
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF

Keep browsing