GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
HY
HyperCLOVAX-SEED-Think-14B
Hyperclovax · naver-ellm
Params14.7B
Context128K
Q4_K_M8.9 GB
Reasoning
LL
Llama 3 Alpha Ko 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
NE
Nemotron 3.5 Bolt 74B A9B 16GB
Nemotron · anik-jha
Params24.4B
Context256K
Smallest9.1 GB
CodingReasoningTool use
HA
Hathor_Tahsin-L3-8B-v0.85
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
FL
Flux3 PE GGUF Comfy
Flux · t8star
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
FA
Falcon3 7B Instruct Abliterated
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
FU
Fun-ASR-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
GGUF
QW
MLXFW Qwen3.8 Flash Next Heretic Q8 0
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
AN
Anima 2.9B
Anima · vanes430
Params5.84B
Context—
Smallest3.3 GB
GGUF
TU
allenai_tulu-2-dpo-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
NE
Nemostein 3 Hermes Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
FA
Falcon H1 7B Instruct
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen Image 2.1 PE T2I Pocket 0.8B
Qwen · ML-Intern-lab
Params752M
Context256K
Smallest0.8 GB
GGUF
WA
WazoCore 8B v6 Long
Wazocore · mradermacher
Params8.15B
Context128K
Q4_K_M5.0 GB
Tool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Pollard
Nemotron · PollardWeights
Params74B
Context256K
Smallest17.9 GB
ReasoningTool useVision
DE
deepseek coder v2 lite instruct
DeepSeek · mad-lab-ai
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
MathSmith HC Qwen3 8B Qwen2_5 32B ShortCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · rayss868123
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
Qwen2 72B Instruct
Qwen · Qwen
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
RE
Rex Frame 3B
Rex · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision

Keep browsing