GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
RI
RigoChat 7b v2
Rigochat · IIC
Params7.62B
Context32K
Q4_K_M4.7 GB
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
LA
Laguna S 2.1 ROCmFP4 STRIX LEAN
Laguna · kingjones777
Params118B
Context256K
Smallest62.6 GB
NE
Nemotron 3.5 Lightning 30B A3B Uncensored xCloud
Nemotron · xCloudinfo
Params32.9B
Context1024K
Q4_K_M25.4 GB
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · saidutta69
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
ST
stablelm-zephyr-3b
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ3 XXS 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest60.5 GB
CH
chronoboros 33B i1
Chronoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
AL
Alpacino30b i1
Alpacino · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen Image 2.1 Uncensored HF
Qwen · NeverWantedJr
Params7.12B
Context—
Q4_K_M4.6 GB
LA
adaptllm_law-llm-13b
Law · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Swift1.5 Qwen3.8 Flash Next
Qwen · tirex2001
Params56.1B
Context256K
Smallest60.4 GB
HE
HelpingAI-9B-200k
Helpingai · mradermacher
Params8.83B
Context195K
Q4_K_M5.3 GB
FI
adaptllm_finance-llm
Finance · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
SE
SeaLLM-7B-v2
Seallm · mradermacher
Params7.38B
Context32K
Q4_K_M4.5 GB
LF
LiquidAI.LFM2 2.6B Transcript
Lfm · DevQuasar
Params2.57B
Context125K
Q4_K_M1.6 GB
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
CH
elinas_chronos-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TE
migtissera_tess-34b-v1.5b
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
IN
amd.Instella MoE 16B A3B Think
Instella · DevQuasar
Params15.9B
Context32K
Smallest6.5 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
PA
Palmyra-Med-70B
Palmyra · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
ME
MERaLiON 2 3B
Meralion · MERaLiON
Params2.61B
Context8K
Q4_K_M1.7 GB
LF
LFM2.5 Encoder 350M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
QW
ThinkingCap Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB