GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
RU
RusMind 4.5.3 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
GR
Groot 65B A6B 261023
Groot · GrootTeam
Params117B
Context256K
Q4_K_M78.7 GB
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
TU
allenai_tulu-2-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
QW
Minecraftism 4B Uncensored
Qwen · mr-sus
Params4.02B
Context256K
Q4_K_M2.5 GB
QC
qCammel 13
Qcammel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
vietnamese llama2 7B 40GB
Llama · TheBloke
Params6.86B
Context4K
Q4_K_M4.2 GB
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
LF
LFM2.5 24B A2B abliterated mixed
Lfm · Jakevin
Params24B
Context128K
Smallest10.7 GB
IN
Internlm2_5 1_8b Chat
InternLM · legraphista
Params1.89B
Context32K
Smallest0.5 GB
QW
Qwen Image 2.1
Qwen · Supbatomic
Params7.12B
Context—
Q4_K_M4.6 GB
WI
wizardlm_wizardmath-7b-v1.1
Wizardmath · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
RU
RusMind 4.5 Vspyshka
Rusmind · DICPlay
Params7.52B
Context128K
Smallest15.1 GB
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
DE
Deepseek LLM 7B Chat
DeepSeek · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
LL
ehartford_dolphin-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
DR
Drex v1.5
Drex · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
MI
MiniMax M3.1 Flash StrixHalo
Minimax · Harsha001
Params313B
Context1024K
Smallest96.6 GB
NE
Nemotron 3.5 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
BA
weyaxi_bagel-hermes-2x34b
Bagel · TheBloke
Params60.8B
Context195K
Q4_K_M36.7 GB
BR
Breeze TTS 2
Breeze · Raxdiam
Params—
Context—
Smallest4.3 GB
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB