GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
WI
WizardLM-13B-V1.2
Wizardlm · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
EVA LLaMA 3.33 70B v0.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
glm-4-9b-chat
GLM · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · ggml-org
Params108B
Context10240K
Q4_K_M65.4 GB
LL
ektome_Nemotron Nano 8B
Llama · Zynerji
Params8.03B
Context128K
Q4_K_M4.9 GB
BH
BharatGPT 3B Indic i1
Bharatgpt · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GL
Glm Edge V 5b
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
QW
qwen3.8 flash next ds4 64gb mac
Qwen · ansoncat
Params180B
Context256K
Smallest139.4 GB
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
FA
Falcon3 Mamba 7B Base i1
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
QW
stream 1 mini
Qwen · whisperstream
Params752M
Context32K
Q4_K_M0.5 GB
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CO
c4ai command r7b 12 2024 heretic
Command R · saidutta69
Params8.03B
Context129K
Q4_K_M5.1 GB
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
KI
moonshotai Kimi K2 Instruct 0905
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
Qwen3.8 Flash Next
Qwen · WhiskyAKM
Params177B
Context256K
Smallest2.4 GB
GL
glm-4-9b-chat-1m
GLM · legraphista
Params9.48B
Context1024K
Smallest4.0 GB
LO
LocateAnything 3B
Locateanything · yuuko-eth
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.8 Flash Next Uncensored R9V IQ4 XS
Qwen · Dyluhn
Params177B
Context256K
Smallest93.7 GB
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
LL
llama-3-gutenberg-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LT
ltx video 2b v0.9.1
Ltx · pollockjj
Params1.92B
Context—
Smallest0.7 GB
LF
LFM3 VL 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
DE
deepseek-ai_deepseek-coder-6.7b-instruct
DeepSeek · Dzluck
Params6.74B
Context16K
Q4_K_M4.1 GB