GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
QW
English Document OCR Qwen3.5 2B
Qwen · loay
Params1.88B
Context256K
Q4_K_M1.3 GB
MA
MarChat V1 27B
Marchat · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
MI
DopeorNope Mistralopithecus v0.1 10.8B
Mistral · RichardErkhov
Params10.8B
Context32K
Q4_K_M6.5 GB
AI
AILO-152M-v2
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
Bytedance Research.Pasa 7b Selector
Pasa · DevQuasar
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
PlatYi 34B Llama Q v2
Llama · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
DR
DRT 8B i1
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
Finbert
Finbert · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
SE
Self Forcing2.1 I2V 1.3B
Self · Nichonauta
Params2.15B
Context—
Smallest1.3 GB
CA
calm3 22b RP
Calm · Aratako
Params22.5B
Context16K
Q4_K_M13.6 GB
TO
TowerVision 9B
Tower · nyuuzyou
Params9.24B
Context8K
Q4_K_M5.8 GB
DR
DRT 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
IN
UI Ins 32B
Ins · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
PL
PlatYi 34B 200K Q
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
SP
splade cocondenser selfdistil
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
CU
Custom KoLLM 13B v8
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
PA
pankajmathur orca mini 3b
Pankajmathur · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
DR
DRT O1 8B
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SP
splade disco human i1
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
KU
Kurugai EEVE v1.0
Kurugai · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
CA
CarbonVillain En 10.7B v5
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GR
GRPO Think 14B 8k
Grpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ME
MediX R1 30B
Medix · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
ROLEPL AI v2 Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
SO
SOLARC MOE 10.7Bx6 i1
Solarc · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
AN
ANKH3_xl
Ankh · mradermacher
Params5.73B
Context512
Q4_K_M3.8 GB
GE
Lite OmniJev
Gemma · Chinzhu
Params7.52B
Context128K
Q4_K_M5.3 GB
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB