GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Prettybird_Bce_Basic_Coder_8B
Qwen · mradermacher
Params7.6B
Context63K
Q4_K_M4.7 GB
PI
PixelWave FLUX.1 dev 03
Pixelwave · mikeyandfriends
Params11.9B
Context—
Q4_K_M6.9 GB
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
QW
Qwen3.8 Flash Next MTP
Qwen · dzannotti
Params3.88B
Context256K
Q4_K_M2.6 GB
FL
FLUX.1 Krea dev
Flux · InvokeAI
Params11.9B
Context—
Q4_K_M6.9 GB
ST
StableBeluga 7B
Stablebeluga · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
NVIDIA-Nemotron-3-Nano-Omni-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ngquocvinh
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
ME
adaptllm_medicine-llm
Medicine · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
NE
Nemotron Mini 4B Instruct
Nemotron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
CO
ComfyUI Starter Packs
Comfyui · MaxedOut
Params4.76B
Context—
Q4_K_M9.7 GB
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
QW
Swift 1.5 Qwen3.8 27B PXQN OneCard
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
BA
bagel 8b v1.0 i1
Bagel · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
FL
FLUX.1 Fill dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
LT
LTX 2.5 22B dev uncensored ROCmFPX
Ltx · Harsha001
Params13.1B
Context—
Smallest14.7 GB