GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
PornMaster Klein 9b
Flux · rectangleworm
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
OM
D1 Omni 2B
Omni · LiquidAI
Params1.73B
Context125K
Smallest1.8 GB
ReasoningTool useVision
FL
FLUX.1 Kontext dev
Flux · bullerwins
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
NE
NVIDIA Nemotron 3.5 Bolt Turbo Brilliance 50x 74B A9B 24GB
Nemotron · DavidAU
Params74B
Context256K
Smallest1.0 GB
CodingReasoningVision
LL
Llama 3 8B Lexi Uncensored
Llama · Orenguteng
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LF
LFM2 1.2B
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
SO
Solar Open2 250B Mixed Quant
Solar · Baekpica
Params250B
Context—
Smallest95.5 GB
GGUF
CY
CYBER-FROST-3.8-PS-GUFF
Cyber · peasantsmith
Params180B
Context256K
Smallest112.5 GB
Tool use
LT
LTX 2.3
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
QW
Qwen Image 2.1
Qwen · AlperKTS
Params7.12B
Context—
Smallest4.9 GB
GGUF
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LT
LTX 2.3 22B DISTILLED 1.1
Ltx · Abiray
Params21B
Context—
Q4_K_M17.8 GB
GGUF
GR
TwIL LM3 Pro
Granite · webAI-Official
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen_Qwen3.8 Flash Next
Qwen · lmstudio-community
Params177B
Context256K
Q4_K_M119.2 GB
Vision
QW
Swift Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
Vision
LT
LTX Video 0.9.6 distilled
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
LA
m51Lab MiniMax M2.7 REAP 139B A10B
Lab · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
GGUF
NE
DictaLM 3.0 Nemotron 12B Instruct
Nemotron · dicta-il
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
QW
Qwen3.8 Flash Next Coder cut240
Qwen · Schiltmans
Params56.6B
Context256K
Smallest4.5 GB
Coding
QW
Qwen3.8 Flash Next S abliterated Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB
GGUF
FA
FastH3 Omni
Fasth · Abiray
Params22.1B
Context—
Q4_K_M12.7 GB
GGUF
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Qwen Image 2.1 Turbo Quantized
Qwen · abenzerps
Params7.1B
Context—
Q4_K_M4.1 GB
GGUF
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing