GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
moonshotai.Kimi K2 Instruct BF16
Kimi · DevQuasar
Params1030B
Context128K
Q4_K_M620.6 GB
Tool use
LF
lfm3 1.7B abliter8
Lfm · abliter8-ai
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
LF
LFM2.5-24B-A2B-Preview
Lfm · TechnoBaptist
Params24B
Context128K
Smallest7.5 GB
ReasoningTool use
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
GR
Grok Oss Apollyon 8B
Grok · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PS
Psyfighter2 Orca2 13B ties i1
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
KukulStanta 7B i1
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NexusRaven V2 13B
Nexusraven · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 32B
Qwen · second-state
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Swift Qwen3.8 27B Abliterated
Qwen · andrewting
Params27.3B
Context256K
Smallest13.2 GB
ReasoningTool useVision
JA
ai21labs.AI21 Jamba Large 1.7
Jamba · DevQuasar
Params399B
Context256K
Q4_K_M240.3 GB
Tool use
QW
Qwen3.8 27B EAGLE4
Qwen · quimmedes
Params1.79B
Context256K
Smallest0.6 GB
ReasoningTool use
FA
Falcon3 1B Instruct 1.58bit
Falcon · XXXXyu
Params1.67B
Context8K
Smallest0.6 GB
Tool use
QW
SAND Math Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
HY
HyperCLOVAX SEED Vision Instruct 3B
Hyperclovax · naver-ellm
Params3.26B
Context128K
Q4_K_M2.0 GB
Vision
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
PH
phi4 multimodal quantisized
Phi · ShayanCyan
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool useVision
LF
cowork companion
Lfm · chadstthomas
Params354M
Context125K
Smallest0.2 GB
Tool use
DE
Deepseek Coder 33b Instruct
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
SA
49 SauerkrautLM 8B Instruct i1
Sauerkrautlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Vinci Cyber 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
Coding
LI
L3-8B-LingYang-v1
Lingyang · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
QW
Qwen Image 2.1 viggle turbo
Qwen · daniel042310
Params7.12B
Context—
Q4_K_M4.3 GB
GGUF
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
FA
Falcon H1 1.5B Deep Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
LF
LFM2.5 VL 1.6B Extract Tied
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool useVision

Keep browsing