GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
Meta-Llama-3-8B-Instruct
Llama · AI-Engine
Params8.03B
Context8K
Smallest3.2 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · vcruz305
Params31.6B
Context1024K
Smallest9.8 GB
CH
digitous_13b-chimera
Chimera · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LT
LTX 2.3 DEV
Ltx · Viper-AI-Vaunt
Params21B
Context—
Q4_K_M14.2 GB
QW
ThinkingCap-Qwen3.8-27B-abliterated
Qwen · groxaxo
Params27.3B
Context256K
Smallest1.4 GB
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
HU
HunyuanOCR
Hunyuanocr · mradermacher
Params539M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Medichat-V2-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
FinGPT MT Llama 3 8B LoRA
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
HU
hunyuan
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
WA
wai-illustrious-sdxl.fp16.gguf
Wai · void-gryph
Params2.57B
Context77
Q4_K_M1.4 GB
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen2.5 3b Chess v7
Qwen · Ryu-tek
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Sakura Qwen Image 2.1 PE T2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
RU
RusMind 4.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest8.2 GB
SK
Skyfall 36B V2A
Skyfall · TheDrummer
Params36.9B
Context32K
Q4_K_M22.4 GB
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
Deepthink Reasoning 7B imatrix
Deepthink · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
LF
LFM3 1.7B abliterated
Lfm · bowtiedrahman
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB