GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
bahasa-4b-v2
Bahasa · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
TU
allenai_tulu-2-dpo-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
GGUF
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
RoleplayVision
MA
Magicoder S DS 6.7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HA
Hathor_Stable-v0.2-L3-8B
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Swift Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
ST
stable code 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Meta-Llama-3-8B-Instruct
Llama · duyntnet
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
LF
LFM2.5 24B A2B
Lfm · richardyoung
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
QW
Spark X2.5 4B Therapy InterleavedThink Qwen38FlashNext MiniMaxM3 GLM5.3 ZCode SFT8K MultiDPO v3h
Qwen · denjhang
Params4.1B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · ymcki
Params51.5B
Context128K
Q4_K_M31.0 GB
GGUF
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · AaryanK
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingTool use
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
QW
Arch Router
Qwen · katanemo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
meta-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AI
Airoboros L2 7b Gpt4 M2.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DR
Drex v2.0
Drex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
MY
Mythomax L2 13b Q4 K M
Mythomax · Clevyby
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LT
Nz LTX25 weights
Ltx · Rootport
Params21B
Context—
Smallest14.7 GB
GGUF

Keep browsing