GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CI
Cicikus v3 1.4B Opus4.6 Powered
Cicikus · mradermacher
Params1.36B
Context128K
Q4_K_M0.9 GB
Reasoning
WI
WizardLM 7B V1.0 Uncensored
Wizardlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · gaianet
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
DE
Delexa-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Ektome Nemotron Nano 8B PristinelyUncensored
Nemotron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OR
orca mini v3 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
MiniCPM-3B-OpenHermes-2.5-v2
MiniCPM · duyntnet
Params3.01B
Context2K
Q4_K_M2.0 GB
Tool use
LL
llama guard quant
Llama · tybrs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hakeem 7B
Hakeem · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
SA
Sauerkraut Proverbs 8B i1
Sauerkraut · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Scarlett-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
HE
HelpingAI2.5 10B
Helpingai · mradermacher
Params10.2B
Context128K
Q4_K_M6.2 GB
Tool use
NE
Nemotron Nano 9B v2 Heretic
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
OP
openNemo 9B
Opennemo · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
WH
psiuu
Whisper · llaosdigital
Params627M
Context—
Smallest0.7 GB
GGUF
MA
magnum v1 32b
Magnum · anthracite-org
Params32.5B
Context32K
Smallest10.3 GB
GGUF
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
ReasoningTool use
CY
Cydonia v1.3 Magnum v4 22B
Cydonia · knifeayumu
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
QW
32B Qwen2.5 Kunou v1 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
Qwen2.5 72B Instruct Abliterated v2
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
NU
Nuggies 4B i1
Nuggies · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
RoleplayTool use
LF
LFM2.5 2.6B Opencode RL
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
BA
Baichuan2 13B Chat
Baichuan · mradermacher
Params13.9B
Context4K
Q4_K_M9.0 GB
GGUF
AP
Nous 1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron 3.5 Bolt E4B
Nemotron · avar6
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
QW
Qwen3 Omni 30B A3B Thinking Heretic
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool use
QW
Qwopus Omnicoder Abliterated
Qwopus · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
KY
Kyro n1.1 7B pytorch i1
Kyro · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen3.8 Flash Next refusal projection
Qwen · Cudecnik
Params—
Context—
Smallest0.0 GB
GGUF

Keep browsing