GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
SQ
sqlcoder
Sqlcoder · QuantFactory
Params15.8B
Context8K
Q4_K_M10.1 GB
GE
zephyr 7b gemma sft v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
AI
henk717_airochronos-33b
Airochronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · sugatoray
Params15.7B
Context160K
Q4_K_M10.4 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · second-state
Params1.64B
Context4K
Q4_K_M1.0 GB
HI
HiViG Critic
Hivig · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LT
LTX Video 0.9.8 2B distilled
Ltx · oxide-lab
Params4.76B
Context512
Smallest3.4 GB
QW
Huihui Qwen3.6 27B abliterated Q4 K M
Qwen · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
LL
Llama3 DocChat 1.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
HO
Home 3B v3
Home · acon96
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Qwen2.5 7B Instruct 1M heretic
Qwen · saidutta69
Params7.62B
Context986K
Q4_K_M4.7 GB
QW
Qwen.Qwen3.8 Flash Next
Qwen · DevQuasar
Params177B
Context256K
Smallest80.4 GB
AN
Anima2
Anima · JusteLeo
Params2.09B
Context—
Q4_K_M1.2 GB
QW
Qwen1.5 32B Chat
Qwen · Qwen
Params32.5B
Context32K
Q4_K_M19.7 GB
QW
ThinkingCap Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LF
LFM2 24B A2B APEX
Lfm · mudler
Params23.8B
Context125K
Smallest9.5 GB
NE
Nemotron Terminal 14B Heretic
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
CH
elinas_chronos-33b
Chronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
PU
PuddleJumper 13b V2
Puddlejumper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
HO
Holotron4 30B A3B
Holotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
SA
SanGuoYanYi 6b
Sanguoyanyi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
IN
InternVL2_5 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AP
Apollo 1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LF
LFM2.5 8B A1B ThinkingCap
Lfm · Davd-b01
Params8.47B
Context125K
Q4_K_M0.2 GB