GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context32K
Q4_K_M4.7 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
LF
Abliterated
Lfm · alexwkleung
Params24B
Context128K
Q4_K_M14.5 GB
LF
LFM2.5 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
QW
Qwen Qwen3.8 27B GGUF IQ1 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · LoneStriker
Params15.7B
Context160K
Q4_K_M10.4 GB
LF
LFM2.5 VL 3B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
FL
flux dev
Flux · gguf-org
Params123M
Context—
Q4_K_M6.7 GB
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.8 Flash Next
Qwen · batiai
Params177B
Context256K
Q4_K_M119.2 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
LF
LFM2 8B A1B
Lfm · bartowski
Params8.34B
Context125K
Q4_K_M5.1 GB
RU
RusMind.Вспышка 3.2
Rusmind · DICPlay
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
models--google--gemma-7b
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
TH
thinksound
Thinksound · ilintar
Params—
Context—
Smallest0.0 GB
MI
MiniMax M3 Uncensored
Minimax · spiritfather
Params426B
Context1024K
Q4_K_M264.3 GB