GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next Abliterated
Qwen · apetersson
Params177B
Context256K
Smallest184.3 GB
Vision
FO
Foundation Sec 8B Reasoning
Foundation · fdtn-ai
Params8B
Context128K
Smallest8.5 GB
Reasoning
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
QW
Qwen Image 2.1 Turbo GGUFs
Qwen · realrebelai
Params7.12B
Context—
Smallest3.3 GB
GGUF
LL
Meta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SD
sdxl turbo
Sdxl · OlegSkutte
Params3.47B
Context—
Smallest4.1 GB
GGUF
FI
Fibo 2.0 edit turbo
Fibo · Abiray
Params8.23B
Context—
Q4_K_M5.3 GB
GGUF
QW
Qwen3.8 Flash Next PaoAI STRIX BALANCED 2
Qwen · PaoAI
Params177B
Context256K
Smallest78.3 GB
GGUF
FA
Falcon H1 7B Instruct
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B APEX
Nemotron · mudler
Params121B
Context—
Smallest8.9 GB
GGUF
FL
FLUX.1 dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
GGUF
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingVision
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Qwen1.5-7B-Chat-AWQ-fp16
Qwen · Qwen
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
KI
Kimi-K3
Kimi · hellohazime
Params1810B
Context1024K
Smallest441.4 GB
GGUF
LF
LFM2.5 8B A1B heretic
Lfm · saidutta69
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningRoleplayTool use
ST
stablelm zephyr 3b
Stablelm · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Swift 2.5bit 352E 32GB
Qwen · webmp3
Params139B
Context256K
Smallest57.0 GB
GGUF
LL
meta-llama-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LF
LFM2 1.2B Tool
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
MI
MiniMax M2.1
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
OP
OpenCoder 1.5B Instruct
Opencoder · lmstudio-community
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB
Coding
QW
Qwen3.8 Flash Next Heretic 2
Qwen · Deritak
Params128B
Context256K
Smallest91.5 GB
Vision
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
CaptchaKraken v1.2
Qwen · CaptchaKraken
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision

Keep browsing