GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta-Llama-3-8B-Instruct
Llama · AI-Engine
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · vcruz305
Params31.6B
Context1024K
Smallest9.8 GB
GGUF
CH
digitous_13b-chimera
Chimera · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LT
LTX 2.3 DEV
Ltx · Viper-AI-Vaunt
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
ThinkingCap-Qwen3.8-27B-abliterated
Qwen · groxaxo
Params27.3B
Context256K
Smallest1.4 GB
ReasoningVision
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
GGUF
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · mradermacher
Params539M
Context32K
Q4_K_M0.4 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
Medichat-V2-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
FinGPT MT Llama 3 8B LoRA
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
HU
hunyuan
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
WA
wai-illustrious-sdxl.fp16.gguf
Wai · void-gryph
Params2.57B
Context77
Q4_K_M1.4 GB
GGUF
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen2.5 3b Chess v7
Qwen · Ryu-tek
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Sakura Qwen Image 2.1 PE T2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
RU
RusMind 4.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest8.2 GB
ReasoningTool use
SK
Skyfall 36B V2A
Skyfall · TheDrummer
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
DE
Deepthink Reasoning 7B imatrix
Deepthink · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LF
LFM3 1.7B abliterated
Lfm · bowtiedrahman
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
MiMo V2.6 Distill Qwen 9B
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingTool useVision

Keep browsing