GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-Flash-Next
Qwen · ji-farthing
Params177B
Context256K
Smallest2.4 GB
GGUF
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
LF
LFM2.5 24B A2B
Lfm · bartowski
Params24B
Context128K
Q4_K_M15.4 GB
GGUF
QW
Qwen Image 2.1 viggle turbo v0.2.1 6step
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
ME
Medgemma 4b It
Medgemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · WANG-CC
Params8.19B
Context40K
Smallest8.7 GB
Coding
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
Vision
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
DR
Drex v1.5
Drex · nace-ai
Params9B
Context256K
Smallest9.5 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
GGUF
QW
Qwen3.8 Flash Next Heretic2 IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
FL
FLUX.2 Klein 9B KV
Flux · QuantStack
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b MXFP4
Qwen · tsaipifong
Params27.3B
Context256K
Smallest15.5 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · AesSedai
Params180B
Context256K
Q4_K_M116.1 GB
Vision
FL
flux imatrix
Flux · Eviation
Params11.9B
Context—
Q4_K_M6.7 GB
GGUF
LF
LFM2.5-8B-A1B-Uncensored-Gaston
Lfm · gaston-parravicini
Params8.47B
Context125K
Q4_K_M5.2 GB
Reasoning
LT
LTX 2.5 Comfy
Ltx · ruygar
Params21B
Context—
Smallest7.3 GB
GGUF
ER
10Eros Max Turbo Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
FU
sayit asr
Fun · cswk
Params830M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
NE
Nemotron 3.5 Bolt E4B GSQ RCO
Nemotron · abenzerps
Params7.52B
Context128K
Smallest0.4 GB
ReasoningTool useVision
IN
InternLM2
InternLM · legraphista
Params7.74B
Context8K
Smallest1.9 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B Pollard
Nemotron · PollardWeights
Params7.52B
Context128K
Q4_K_M0.2 GB
ReasoningTool useVision
MI
Mistral Small Instruct 2409
Mistral · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · dphn
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use

Keep browsing