GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
KI
moonshotai.Kimi K2 Instruct BF16
Kimi · DevQuasar
Params1030B
Context128K
Q4_K_M620.6 GB
LF
lfm3 1.7B abliter8
Lfm · abliter8-ai
Params1.73B
Context256K
Q4_K_M1.1 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · TechnoBaptist
Params24B
Context128K
Smallest7.5 GB
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
GR
Grok Oss Apollyon 8B
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PS
Psyfighter2 Orca2 13B ties i1
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KU
KukulStanta 7B i1
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NexusRaven V2 13B
Nexusraven · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3 32B
Qwen · second-state
Params32.8B
Context40K
Q4_K_M19.8 GB
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Swift Qwen3.8 27B Abliterated
Qwen · andrewting
Params27.3B
Context256K
Smallest13.2 GB
JA
ai21labs.AI21 Jamba Large 1.7
Jamba · DevQuasar
Params399B
Context256K
Q4_K_M240.3 GB
QW
Qwen3.8 27B EAGLE4
Qwen · quimmedes
Params1.79B
Context256K
Smallest0.6 GB
FA
Falcon3 1B Instruct 1.58bit
Falcon · XXXXyu
Params1.67B
Context8K
Smallest0.6 GB
QW
SAND Math Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
HY
HyperCLOVAX SEED Vision Instruct 3B
Hyperclovax · naver-ellm
Params3.26B
Context128K
Q4_K_M2.0 GB
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
PH
phi4 multimodal quantisized
Phi · ShayanCyan
Params3.84B
Context128K
Q4_K_M2.5 GB
LF
cowork companion
Lfm · chadstthomas
Params354M
Context125K
Smallest0.2 GB
DE
Deepseek Coder 33b Instruct
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
SA
49 SauerkrautLM 8B Instruct i1
Sauerkrautlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
Vinci Cyber 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
LI
L3-8B-LingYang-v1
Lingyang · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
QW
Qwen Image 2.1 viggle turbo
Qwen · daniel042310
Params7.12B
Context—
Q4_K_M4.3 GB
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
FA
Falcon H1 1.5B Deep Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
LF
LFM2.5 VL 1.6B Extract Tied
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB