GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
models--google--gemma-7b-it
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
MO
Morrow 2.6B
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
MI
Mira 1 Large 0919
Mira · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
PL
PlanoO Zirelum
Planoo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bottlecapai
Params32.9B
Context1024K
Q4_K_M25.4 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
OR
OrcaMaid 13B
Orcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen Image 2.1 Uncensored
Qwen · Nylonek
Params7.12B
Context—
Q4_K_M4.6 GB
LL
Llama 3 5B Sheard
Llama · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
CH
chronos 33b
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
QW
Qwen3.8 Flash Next strixflash
Qwen · tawei-amd
Params177B
Context256K
Smallest2.8 GB
EZ
Ezjev 4b S2
Ezjev · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
BA
bagel dpo 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
SR
SRPO Refine Quantized v1.0
Srpo · wikeeyang
Params11.9B
Context—
Smallest7.7 GB
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
TE
migtissera_tess-m-v1.1
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen1.5 14B Chat
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
CA
Captain Eris Violet V0.420 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LF
LFM2 1.2B Hi Fi
Lfm · fraQtl
Params1.17B
Context125K
Smallest0.7 GB
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
OR
Ornith 1.0 35B AEON Ultimate Uncensored
Ornith · vcruz305
Params34.7B
Context256K
Q4_K_M21.2 GB
MU
Muse Spark Open 816B A42B GGUF UltraOptimised Curated Protium
Muse · Solstice-AI
Params816B
Context—
Smallest0.8 GB
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3 bophades v2 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB