GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v2
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
NE
Nemotron 3.5 Super VL 120B A12B CYBER NVFP4
Nemotron · dealignai
Params124B
Context1024K
Smallest73.2 GB
ReasoningTool useVision
LF
LFM2 350M ENJP MT
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
GE
NVIDIA GEM-X SOMA regression denoiser
Gem · LocalAI-io
Params44M
Context120
Smallest0.2 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
Coding
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
PL
Plamo 3 Nict 2b Base
Plamo · mmnga-o
Params2.6B
Context4K
Q4_K_M1.7 GB
GGUF
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Mistral NeMo Minitron 8B Instruct
Mistral · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · prithivMLmods
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
QW
Sakura Qwen Image 2.1 PE I2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
RU
RusMind.Моментум 3.5.1
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
NE
Huihui NVIDIA Nemotron Nano 9B v2 Abliterated
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
QW
qwen38 flash next v3
Qwen · nitinpanj
Params177B
Context256K
Q4_K_M1.9 GB
GGUF
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
GGUF
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
Reasoning
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing