GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
English Document OCR Qwen3.5 2B
Qwen · loay
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MA
MarChat V1 27B
Marchat · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
MI
DopeorNope Mistralopithecus v0.1 10.8B
Mistral · RichardErkhov
Params10.8B
Context32K
Q4_K_M6.5 GB
GGUF
AI
AILO-152M-v2
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
CodingReasoning
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Bytedance Research.Pasa 7b Selector
Pasa · DevQuasar
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
PlatYi 34B Llama Q v2
Llama · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DR
DRT 8B i1
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
FI
Finbert
Finbert · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
SE
Self Forcing2.1 I2V 1.3B
Self · Nichonauta
Params2.15B
Context—
Smallest1.3 GB
GGUF
CA
calm3 22b RP
Calm · Aratako
Params22.5B
Context16K
Q4_K_M13.6 GB
Roleplay
TO
TowerVision 9B
Tower · nyuuzyou
Params9.24B
Context8K
Q4_K_M5.8 GB
Vision
DR
DRT 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
IN
UI Ins 32B
Ins · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
PL
PlatYi 34B 200K Q
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
SP
splade cocondenser selfdistil
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Coding
CU
Custom KoLLM 13B v8
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PA
pankajmathur orca mini 3b
Pankajmathur · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
DR
DRT O1 8B
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SP
splade disco human i1
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
KU
Kurugai EEVE v1.0
Kurugai · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
CA
CarbonVillain En 10.7B v5
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GR
GRPO Think 14B 8k
Grpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
ME
MediX R1 30B
Medix · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
QW
ROLEPL AI v2 Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
RoleplayTool use
SO
SOLARC MOE 10.7Bx6 i1
Solarc · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
AN
ANKH3_xl
Ankh · mradermacher
Params5.73B
Context512
Q4_K_M3.8 GB
GGUF
GE
Lite OmniJev
Gemma · Chinzhu
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF

Keep browsing