GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
EX
K EXAONE 236B A23B
Exaone · mradermacher
Params236B
Context256K
Q4_K_M143.5 GB
GGUF
LL
Medichat Llama3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
Vision
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OP
openbuddy-zen-3b-v21.2-32k
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
GGUF
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
MI
Minicpm5_1B_Agentic_Tooluse_Merged_Fp16_Ggufsafe
MiniCPM · ewin-reg
Params1.08B
Context128K
Q4_K_M0.7 GB
Tool use
NE
Nekomata 7b Instruction
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
BO
Borealis 1b
Borealis · NbAiLab
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.8 Flash Next MTP block
Qwen · paperniuk
Params2.61B
Context256K
Smallest1.5 GB
ReasoningTool use
FO
Foundation Sec 1.1 8B Instruct
Foundation · fdtn-ai
Params8B
Context64K
Q4_K_M4.9 GB
GGUF
VI
neko-institute-of-science_vicunlocked-30b-lora
Vicunlocked · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
CH
chronos 33b i1
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
LL
Llama 7b Hf
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
WI
junelee_wizard-vicuna-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FL
PornMaster flux2 klein 9b
Flux · placetrtr
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
QW
Qwen-Image-2.1-PE-I2I
Qwen · lightx2v
Params8.95B
Context256K
Smallest9.5 GB
Vision
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
SE
SeaLLMs v3 7B
Seallms · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Keep browsing