GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenCoder 1.5B Instruct
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
LO
longchat 13b 16k
Longchat · shaowenchen
Params13B
Context16K
Smallest5.4 GB
GGUF
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XC
XCurOS 1.2 8B VLBF16 Instruct
Xcuros · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
VO
KO VoicePersona E4B
Voicepersona · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
QW
Tessera 125B MoE
Qwen · Voidstackloop
Params162B
Context256K
Smallest2.9 GB
ReasoningTool use
DA
Darwin 180B RSI Mixed Quant
Darwin · Baekpica
Params129B
Context256K
Smallest83.3 GB
ReasoningTool useVision
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
GGUF
AN
M3.1 24B Animus V4 Final
Animus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
RoleplayVision
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Smallest12.1 GB
CodingTool use
QW
Swift 1.5 Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
GGUF
LL
Llama 3 DARE 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Litovation
Params638M
Context—
Q4_K_M0.5 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB
ReasoningTool useVision
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GGUF
NE
FleetWorker E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
GGUF
CI
Cipher 20B i1
Cipher · mradermacher
Params20.6B
Context32K
Q4_K_M12.4 GB
CodingTool use
GR
Grug 12B
Grug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
CY
Cydonia 24B v3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MO
Moonshine Tiny (Arabic)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
WA
wavecoder ultra 6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
BL
BlueMagpie TTS
Bluemagpie · BricksDisplay
Params942M
Context—
Q4_K_M0.7 GB
GGUF
QW
Qwen1.5-4B-Chat
Qwen · second-state
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
IN
Internlm2_5 7b Chat 1m
InternLM · second-state
Params7.74B
Context256K
Q4_K_M4.7 GB
Coding

Keep browsing