GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v2
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
NE
Nemotron 3.5 Super VL 120B A12B CYBER NVFP4
Nemotron · dealignai
Params124B
Context1024K
Smallest73.2 GB
LF
LFM2 350M ENJP MT
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GE
NVIDIA GEM-X SOMA regression denoiser
Gem · LocalAI-io
Params44M
Context120
Smallest0.2 GB
QW
Qwen2.5 Coder 3B
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
PL
Plamo 3 Nict 2b Base
Plamo · mmnga-o
Params2.6B
Context4K
Q4_K_M1.7 GB
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · prithivMLmods
Params7.52B
Context64K
Q4_K_M5.3 GB
QW
Sakura Qwen Image 2.1 PE I2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
RU
RusMind.Моментум 3.5.1
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
NE
Huihui NVIDIA Nemotron Nano 9B v2 Abliterated
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
QW
qwen38 flash next v3
Qwen · nitinpanj
Params177B
Context256K
Q4_K_M1.9 GB
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB