GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Octen WebGR 4B imatrix
Qwen · liodon-ai
Params4.36B
Context32K
Q4_K_M2.8 GB
IQ
IQuest Coder V1 7B Instruct
Iquest · xhxlb
Params7.61B
Context128K
Q4_K_M4.6 GB
LE
Legml v1.0 Base
Legml · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NU
NuminaMath 72B TIR i1
Numinamath · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Sakura Qwen3.8 Flash Next Swift 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.5 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q6 K
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.5 GB
TI
TimeLens 8B
Timelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
OM
Omega Darker Gaslight_The Final Forgotten Fever Dream 24B
Omega · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LU
lucid v1 nemo i1
Lucid · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
GE
Gemma 3 12b It Heretic
Gemma · saidutta69
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Swift 1.5 Qwen3.8 Flash Next Q4 K XL
Qwen · ethanwtodd
Params177B
Context256K
Smallest111.3 GB
FL
Flux Fusion V2 4step merge gguf nf4
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
JA
AI21 Jamba Mini 1.5
Jamba · mradermacher
Params51.6B
Context256K
Q4_K_M31.2 GB
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · AzynTT
Params3.4B
Context32K
Q4_K_M2.1 GB
LF
LFM2 1.2B Tool
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
QW
Qwen2-72B-Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · jordi123
Params27.3B
Context256K
Q4_K_M16.8 GB
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
OR
Ornstein-Hermes-3.6-27b-SABER
Ornstein · GestaltLabs
Params26.9B
Context256K
Q4_K_M16.5 GB
DE
deepseek-coder-7b-instruct-v1.5
DeepSeek · qwp4w3hyb
Params6.91B
Context4K
Q4_K_M4.2 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · lmstudio-community
Params1.11B
Context256K
Smallest1.0 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B BF16
Nemotron · AMAImedia
Params32.9B
Context1024K
Smallest1.7 GB
RI
RigoChat 7b v2
Rigochat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
QW
Qwen3.8-27B
Qwen · SixVolts
Params27.3B
Context256K
Smallest1.1 GB