GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Octen WebGR 4B imatrix
Qwen · liodon-ai
Params4.36B
Context32K
Q4_K_M2.8 GB
ReasoningTool use
IQ
IQuest Coder V1 7B Instruct
Iquest · xhxlb
Params7.61B
Context128K
Q4_K_M4.6 GB
CodingTool use
LE
Legml v1.0 Base
Legml · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NU
NuminaMath 72B TIR i1
Numinamath · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Swift 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.5 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q6 K
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.5 GB
ReasoningRoleplayTool use
TI
TimeLens 8B
Timelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OM
Omega Darker Gaslight_The Final Forgotten Fever Dream 24B
Omega · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
LU
lucid v1 nemo i1
Lucid · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
GE
Gemma 3 12b It Heretic
Gemma · saidutta69
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Swift 1.5 Qwen3.8 Flash Next Q4 K XL
Qwen · ethanwtodd
Params177B
Context256K
Smallest111.3 GB
ReasoningTool useVision
FL
Flux Fusion V2 4step merge gguf nf4
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
JA
AI21 Jamba Mini 1.5
Jamba · mradermacher
Params51.6B
Context256K
Q4_K_M31.2 GB
Tool use
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · AzynTT
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
LF
LFM2 1.2B Tool
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
Tool use
QW
Qwen2-72B-Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b
Qwen · jordi123
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
OR
Ornstein-Hermes-3.6-27b-SABER
Ornstein · GestaltLabs
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
DE
deepseek-coder-7b-instruct-v1.5
DeepSeek · qwp4w3hyb
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · lmstudio-community
Params1.11B
Context256K
Smallest1.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B BF16
Nemotron · AMAImedia
Params32.9B
Context1024K
Smallest1.7 GB
GGUF
RI
RigoChat 7b v2
Rigochat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
QW
Qwen3.8-27B
Qwen · SixVolts
Params27.3B
Context256K
Smallest1.1 GB
ReasoningTool use

Keep browsing