GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HY
HyperCLOVAX-SEED-Think-14B
Hyperclovax · naver-ellm
Params14.7B
Context128K
Q4_K_M8.9 GB
LL
Llama 3 Alpha Ko 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
Nemotron 3.5 Bolt 74B A9B 16GB
Nemotron · anik-jha
Params24.4B
Context256K
Smallest9.1 GB
HA
Hathor_Tahsin-L3-8B-v0.85
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
FL
Flux3 PE GGUF Comfy
Flux · t8star
Params8.95B
Context256K
Q4_K_M5.6 GB
FA
Falcon3 7B Instruct Abliterated
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
FU
Fun-ASR-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
QW
MLXFW Qwen3.8 Flash Next Heretic Q8 0
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
AN
Anima 2.9B
Anima · vanes430
Params5.84B
Context—
Smallest3.3 GB
TU
allenai_tulu-2-dpo-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
NE
Nemostein 3 Hermes Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
FA
Falcon H1 7B Instruct
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
QW
Qwen Image 2.1 PE T2I Pocket 0.8B
Qwen · ML-Intern-lab
Params752M
Context256K
Smallest0.8 GB
WA
WazoCore 8B v6 Long
Wazocore · mradermacher
Params8.15B
Context128K
Q4_K_M5.0 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Pollard
Nemotron · PollardWeights
Params74B
Context256K
Smallest17.9 GB
DE
deepseek coder v2 lite instruct
DeepSeek · mad-lab-ai
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
MathSmith HC Qwen3 8B Qwen2_5 32B ShortCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen Image 2.1 Uncensored
Qwen · rayss868123
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen2 72B Instruct
Qwen · Qwen
Params72.7B
Context32K
Q4_K_M47.4 GB
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
RE
Rex Frame 3B
Rex · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB