GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
OP
OpenCoder 1.5B Instruct
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
LO
longchat 13b 16k
Longchat · shaowenchen
Params13B
Context16K
Smallest5.4 GB
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
XC
XCurOS 1.2 8B VLBF16 Instruct
Xcuros · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
VO
KO VoicePersona E4B
Voicepersona · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
QW
Tessera 125B MoE
Qwen · Voidstackloop
Params162B
Context256K
Smallest2.9 GB
DA
Darwin 180B RSI Mixed Quant
Darwin · Baekpica
Params129B
Context256K
Smallest83.3 GB
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
AN
M3.1 24B Animus V4 Final
Animus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Smallest12.1 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
LL
Llama 3 DARE 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Litovation
Params638M
Context—
Q4_K_M0.5 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
NE
FleetWorker E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
CI
Cipher 20B i1
Cipher · mradermacher
Params20.6B
Context32K
Q4_K_M12.4 GB
GR
Grug 12B
Grug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CY
Cydonia 24B v3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MO
Moonshine Tiny (Arabic)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
WA
wavecoder ultra 6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
BL
BlueMagpie TTS
Bluemagpie · BricksDisplay
Params942M
Context—
Q4_K_M0.7 GB
QW
Qwen1.5-4B-Chat
Qwen · second-state
Params3.95B
Context32K
Q4_K_M2.5 GB
IN
Internlm2_5 7b Chat 1m
InternLM · second-state
Params7.74B
Context256K
Q4_K_M4.7 GB