GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
FL
flux 3 image klein sd
Flux · akhaliq
Params5.55B
Context—
Q4_K_M3.3 GB
QW
Qwen3.6 27B Uncensored Heretic DSV4Pro GLM52 SFT GPT55 RL Coding VL MTP
Qwen · nerkyor
Params27B
Context256K
Smallest3.2 GB
KR
Krea 2 Turbo
Krea · stduhpf
Params12.9B
Context—
Smallest4.9 GB
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Qwen Qwen3.8 27B GGUF IQ2 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
LL
Meta Llama 3.1 8B Instruct Heretic
Llama · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Minimax-M2.5
Minimax · mudler
Params229B
Context192K
Smallest85.9 GB
FL
flux.1 dev modern anime full
Flux · alfredplpl
Params11.9B
Context—
Smallest6.8 GB
ST
stable diffusion 3.5 large turbo
Stable · city96
Params8.15B
Context—
Smallest4.8 GB
LL
Yarn-Llama-2-7b-128k
Llama · duyntnet
Params6.74B
Context128K
Q4_K_M4.1 GB
QW
Qwen3.8 Flash Next 99B A5B Niwaki 3bit
Qwen · neopolita
Params105B
Context256K
Smallest42.5 GB
AI
airoboros 34b 3.3
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GL
glm ocr crispembed
GLM · cstr
Params1.11B
Context—
Smallest0.0 GB
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
DE
Qwen3.5 9B DeepSeek V4 Flash MTP HF
DeepSeek · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
llm-compiler-7b-ftd
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
QW
Qwen Image 2.1 Turbo
Qwen · off-grid-ai
Params7.12B
Context—
Smallest4.1 GB
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Coder 7B
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB