GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
UN
Universal Prompt Enhancer 0.8B
Universal · shantanugoel
Params752M
Context256K
Q4_K_M0.5 GB
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
RO
Rocinante 12B V1A
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
TW
TwIL LM3
Twil · NANI-Nithin
Params3.08B
Context64K
Q4_K_M1.9 GB
MA
MagpieLM 4B SFT v0.1
Magpielm · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
QW
Qwen Image 2.1 Uncensored
Qwen · Manusagents
Params7.12B
Context—
Q4_K_M4.6 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
Qwen3.8 Flash Next mixC
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
LF
LFM2.5 24B A2B
Lfm · m9ter1a
Params24B
Context128K
Q4_K_M15.0 GB
CO
C4Ai Command R7B 12 2024 Heretic
Command R · mradermacher
Params8B
Context129K
Q4_K_M5.1 GB
GO
gorilla-llm_gorilla-7b-hf-delta-v0
Gorilla · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
HY
13B HyperMantis
Hypermantis · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
SE
SeaLLM 7B v2.5
Seallm · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
QW
Octen WebGR 0.6B imatrix
Qwen · liodon-ai
Params730M
Context32K
Q4_K_M0.5 GB
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
MI
MiniMax M3.1 Flash Q2 K
Minimax · smalinin
Params2.12B
Context1024K
Smallest3.9 GB
RU
RusMind Vspyshka 4.7
Rusmind · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
LL
dolphin-2.9-llama3-8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
LL
DeepICD R1 Llama 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB