GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Prettybird_Bce_Basic_Coder_8B
Qwen · mradermacher
Params7.6B
Context63K
Q4_K_M4.7 GB
Coding
PI
PixelWave FLUX.1 dev 03
Pixelwave · mikeyandfriends
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
GGUF
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
QW
Qwen3.8 Flash Next MTP
Qwen · dzannotti
Params3.88B
Context256K
Q4_K_M2.6 GB
GGUF
FL
FLUX.1 Krea dev
Flux · InvokeAI
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
ST
StableBeluga 7B
Stablebeluga · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NE
NVIDIA-Nemotron-3-Nano-Omni-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
ReasoningVision
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ngquocvinh
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingTool useVision
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
ME
adaptllm_medicine-llm
Medicine · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
CO
ComfyUI Starter Packs
Comfyui · MaxedOut
Params4.76B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B PXQN OneCard
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
GGUF
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
GGUF
BA
bagel 8b v1.0 i1
Bagel · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
GE
Gemma 2 9b It
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FL
FLUX.1 Fill dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
GGUF
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
LT
LTX 2.5 22B dev uncensored ROCmFPX
Ltx · Harsha001
Params13.1B
Context—
Smallest14.7 GB
GGUF

Keep browsing