GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
EX
K EXAONE 236B A23B
Exaone · mradermacher
Params236B
Context256K
Q4_K_M143.5 GB
LL
Medichat Llama3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
OP
openbuddy-zen-3b-v21.2-32k
Openbuddy · mradermacher
Params4.77B
Context32K
Q4_K_M3.0 GB
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
MI
Minicpm5_1B_Agentic_Tooluse_Merged_Fp16_Ggufsafe
MiniCPM · ewin-reg
Params1.08B
Context128K
Q4_K_M0.7 GB
NE
Nekomata 7b Instruction
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
BO
Borealis 1b
Borealis · NbAiLab
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3.8 Flash Next MTP block
Qwen · paperniuk
Params2.61B
Context256K
Smallest1.5 GB
FO
Foundation Sec 1.1 8B Instruct
Foundation · fdtn-ai
Params8B
Context64K
Q4_K_M4.9 GB
VI
neko-institute-of-science_vicunlocked-30b-lora
Vicunlocked · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
CH
chronos 33b i1
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
LL
Llama 7b Hf
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
WI
junelee_wizard-vicuna-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
FL
PornMaster flux2 klein 9b
Flux · placetrtr
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen-Image-2.1-PE-I2I
Qwen · lightx2v
Params8.95B
Context256K
Smallest9.5 GB
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
SE
SeaLLMs v3 7B
Seallms · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB