GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
QW
CodeQwen1.5 7B Chat
Qwen · mradermacher
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
LL
grok oss Revenant 70B
Llama · c4tdr0ut
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Mistral Large 4 1T A52B Uncensored
Mistral · AtomicChat
Params114M
Context—
Smallest0.5 GB
GGUF
QW
Qwen3 Nemotron 32B RLBFF
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
FA
Falcon H1 34B Base
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
VE
Vev 9b v2
Vev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
NE
Neotoi Coder v2 Beta3 Export
Neotoi · rockypod
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · loscrossos
Params177B
Context256K
Smallest1.2 GB
GGUF
SA
saily 13b v0
Saily · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
MI
minicpm5 1B GLM 5.2 Agentic v9
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
LL
Llama 3 3 Nemotron Super 49B v1 5 i1
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
ReasoningTool use
QW
Qwen3.5 27B_Homebrew
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
swift 1.5 qwen3.8 27b with unsloth iq3 xxs
Qwen · kunthawat
Params461M
Context256K
Smallest10.9 GB
Vision
LL
Llama 3 Synatra 11B v1
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
FA
Falcon H1 7B Base
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
PR
PromptEnhancer Img2img Edit
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
MI
Ministral Instruct 2410 8B DPO RP i1
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · robertbschuette
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
UN
UNA-TheBeagle-7b-v1
Una · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KE
Kernelllm
Kernelllm · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B LexiFun Uncensored V1
Llama · nitsuai
Params8B
Context—
Q4_K_M4.9 GB
Roleplay
PR
prettybird_bce_basic_8B
Prettybird · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GP
gpt-oss-20b-heretic-scannerV1-1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
Elixir Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.16B
Context32K
Q4_K_M2.0 GB
CodingTool use
LL
Meta-Llama-3-8B-Instruct
Llama · SanctumAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
GE
gemma-7b-it
Gemma · second-state
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
GN
gnani evon v3.3 30B A3B
Gnani · luminenio
Params31.7B
Context1024K
Q4_K_M24.7 GB
ReasoningTool use
QW
Qwen Image 2.1 Uncensored Quantized
Qwen · DollasAndSpence
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF

Keep browsing