GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
Universal Prompt Enhancer 0.8B
Universal · shantanugoel
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
RO
Rocinante 12B V1A
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TW
TwIL LM3
Twil · NANI-Nithin
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
MA
MagpieLM 4B SFT v0.1
Magpielm · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · Manusagents
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
QW
Qwen3.8 Flash Next mixC
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
Vision
LF
LFM2.5 24B A2B
Lfm · m9ter1a
Params24B
Context128K
Q4_K_M15.0 GB
ReasoningTool use
CO
C4Ai Command R7B 12 2024 Heretic
Command R · mradermacher
Params8B
Context129K
Q4_K_M5.1 GB
Roleplay
GO
gorilla-llm_gorilla-7b-hf-delta-v0
Gorilla · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
HY
13B HyperMantis
Hypermantis · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
GGUF
SE
SeaLLM 7B v2.5
Seallm · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
QW
Octen WebGR 0.6B imatrix
Qwen · liodon-ai
Params730M
Context32K
Q4_K_M0.5 GB
ReasoningTool use
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
MI
MiniMax M3.1 Flash Q2 K
Minimax · smalinin
Params2.12B
Context1024K
Smallest3.9 GB
ReasoningTool useVision
RU
RusMind Vspyshka 4.7
Rusmind · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
GGUF
LL
DeepICD R1 Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing