GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
GGUF
FL
flux 3 image klein sd
Flux · akhaliq
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
QW
Qwen3.6 27B Uncensored Heretic DSV4Pro GLM52 SFT GPT55 RL Coding VL MTP
Qwen · nerkyor
Params27B
Context256K
Smallest3.2 GB
ReasoningVision
KR
Krea 2 Turbo
Krea · stduhpf
Params12.9B
Context—
Smallest4.9 GB
GGUF
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen Qwen3.8 27B GGUF IQ2 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Heretic
Llama · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Minimax-M2.5
Minimax · mudler
Params229B
Context192K
Smallest85.9 GB
GGUF
FL
flux.1 dev modern anime full
Flux · alfredplpl
Params11.9B
Context—
Smallest6.8 GB
GGUF
ST
stable diffusion 3.5 large turbo
Stable · city96
Params8.15B
Context—
Smallest4.8 GB
GGUF
LL
Yarn-Llama-2-7b-128k
Llama · duyntnet
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.8 Flash Next 99B A5B Niwaki 3bit
Qwen · neopolita
Params105B
Context256K
Smallest42.5 GB
GGUF
AI
airoboros 34b 3.3
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
RoleplayTool use
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GL
glm ocr crispembed
GLM · cstr
Params1.11B
Context—
Smallest0.0 GB
GGUF
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
DE
Qwen3.5 9B DeepSeek V4 Flash MTP HF
DeepSeek · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
LL
llm-compiler-7b-ftd
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · off-grid-ai
Params7.12B
Context—
Smallest4.1 GB
GGUF
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
Reasoning
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Reasoning
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen2.5 Coder 7B
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning

Keep browsing