GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SQ
sqlcoder
Sqlcoder · QuantFactory
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
GE
zephyr 7b gemma sft v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
AI
henk717_airochronos-33b
Airochronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · sugatoray
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
ST
stablelm-2-zephyr-1_6b
Stablelm · second-state
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
HI
HiViG Critic
Hivig · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
LT
LTX Video 0.9.8 2B distilled
Ltx · oxide-lab
Params4.76B
Context512
Smallest3.4 GB
GGUF
QW
Huihui Qwen3.6 27B abliterated Q4 K M
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
LL
Llama3 DocChat 1.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HO
Home 3B v3
Home · acon96
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
QW
Qwen2.5 7B Instruct 1M heretic
Qwen · saidutta69
Params7.62B
Context986K
Q4_K_M4.7 GB
RoleplayTool use
QW
Qwen.Qwen3.8 Flash Next
Qwen · DevQuasar
Params177B
Context256K
Smallest80.4 GB
ReasoningTool useVision
AN
Anima2
Anima · JusteLeo
Params2.09B
Context—
Q4_K_M1.2 GB
GGUF
QW
Qwen1.5 32B Chat
Qwen · Qwen
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
ThinkingCap Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
LF
LFM2 24B A2B APEX
Lfm · mudler
Params23.8B
Context125K
Smallest9.5 GB
GGUF
NE
Nemotron Terminal 14B Heretic
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CH
elinas_chronos-33b
Chronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
GGUF
PU
PuddleJumper 13b V2
Puddlejumper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
HO
Holotron4 30B A3B
Holotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
SA
SanGuoYanYi 6b
Sanguoyanyi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
IN
InternVL2_5 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
AP
Apollo 1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LF
LFM2.5 8B A1B ThinkingCap
Lfm · Davd-b01
Params8.47B
Context125K
Q4_K_M0.2 GB
ReasoningTool use

Keep browsing