GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next Abliterated
Qwen · apetersson
Params177B
Context256K
Smallest184.3 GB
FO
Foundation Sec 8B Reasoning
Foundation · fdtn-ai
Params8B
Context128K
Smallest8.5 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Qwen Image 2.1 Turbo GGUFs
Qwen · realrebelai
Params7.12B
Context—
Smallest3.3 GB
LL
Meta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SD
sdxl turbo
Sdxl · OlegSkutte
Params3.47B
Context—
Smallest4.1 GB
FI
Fibo 2.0 edit turbo
Fibo · Abiray
Params8.23B
Context—
Q4_K_M5.3 GB
QW
Qwen3.8 Flash Next PaoAI STRIX BALANCED 2
Qwen · PaoAI
Params177B
Context256K
Smallest78.3 GB
FA
Falcon H1 7B Instruct
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
NE
NVIDIA Nemotron 3 Super 120B A12B APEX
Nemotron · mudler
Params121B
Context—
Smallest8.9 GB
FL
FLUX.1 dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen1.5-7B-Chat-AWQ-fp16
Qwen · Qwen
Params7.72B
Context32K
Q4_K_M4.8 GB
KI
Kimi-K3
Kimi · hellohazime
Params1810B
Context1024K
Smallest441.4 GB
LF
LFM2.5 8B A1B heretic
Lfm · saidutta69
Params8.47B
Context125K
Q4_K_M5.2 GB
ST
stablelm zephyr 3b
Stablelm · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Sakura Qwen3.8 Flash Next Swift 2.5bit 352E 32GB
Qwen · webmp3
Params139B
Context256K
Smallest57.0 GB
LL
meta-llama-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LF
LFM2 1.2B Tool
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
MiniMax M2.1
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
OP
OpenCoder 1.5B Instruct
Opencoder · lmstudio-community
Params1.91B
Context4K
Q4_K_M1.4 GB
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB
QW
Qwen3.8 Flash Next Heretic 2
Qwen · Deritak
Params128B
Context256K
Smallest91.5 GB
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
CaptchaKraken v1.2
Qwen · CaptchaKraken
Params8.95B
Context256K
Q4_K_M5.6 GB