GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WizardLM-13B-V1.2
Wizardlm · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
EVA LLaMA 3.33 70B v0.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
GL
glm-4-9b-chat
GLM · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
LL
Llama-4-Scout-17B-16E-Instruct
Llama · ggml-org
Params108B
Context10240K
Q4_K_M65.4 GB
Tool useVision
LL
ektome_Nemotron Nano 8B
Llama · Zynerji
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BH
BharatGPT 3B Indic i1
Bharatgpt · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GL
Glm Edge V 5b
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
Vision
QW
qwen3.8 flash next ds4 64gb mac
Qwen · ansoncat
Params180B
Context256K
Smallest139.4 GB
ReasoningTool use
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
FA
Falcon3 Mamba 7B Base i1
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
QW
stream 1 mini
Qwen · whisperstream
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
CO
c4ai command r7b 12 2024 heretic
Command R · saidutta69
Params8.03B
Context129K
Q4_K_M5.1 GB
RoleplayTool use
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
KI
moonshotai Kimi K2 Instruct 0905
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Tool use
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · WhiskyAKM
Params177B
Context256K
Smallest2.4 GB
ReasoningTool useVision
GL
glm-4-9b-chat-1m
GLM · legraphista
Params9.48B
Context1024K
Smallest4.0 GB
GGUF
LO
LocateAnything 3B
Locateanything · yuuko-eth
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
QW
Qwen3.8 Flash Next Uncensored R9V IQ4 XS
Qwen · Dyluhn
Params177B
Context256K
Smallest93.7 GB
ReasoningTool useVision
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
GGUF
LL
llama-3-gutenberg-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LT
ltx video 2b v0.9.1
Ltx · pollockjj
Params1.92B
Context—
Smallest0.7 GB
GGUF
LF
LFM3 VL 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · Dzluck
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing