GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 27b It
Gemma · duyntnet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
IN
Internlm Internlm2_5 7b Chat
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
GGUF
MI
Riva Translate 4B Instruct v2 imatrix
Mistral · liodon-ai
Params4.2B
Context8K
Q4_K_M2.8 GB
GGUF
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
Qwen3.5 27B Uncensored Aggressive
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
PS
Psyfighter2 Orca2 13B ties
Psyfighter · tuantran1632001
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
HelpingAI2 6B
Helpingai · QuantFactory
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
ST
stable diffusion 3.5 medium
Stable · gaianet
Params695M
Context—
Smallest0.1 GB
GGUF
NE
Nekolyne
Nekolyne · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LI
jayyun98/Ling-3.0-Tiny-DSpark
Ling · StefanoBalocco
Params274M
Context128K
Smallest0.1 GB
GGUF
AQ
AquilaChat2 34B 16K
Aquilachat · mradermacher
Params33.7B
Context16K
Q4_K_M20.3 GB
GGUF
LL
Joah-Llama-3-MAAL-MLP-KoEn-8B-Reborn
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
XinYuan Qwen2 7B 0917
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LF
LFM2.5 1.2B Saiga It v3
Lfm · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
EX
EXAONE 4.5 33B
Exaone · mradermacher
Params33.1B
Context256K
Q4_K_M20.0 GB
ReasoningTool use
JA
Jackdaw 30B A3B
Jackdaw · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
QW
Qwen3.8 Flash Next Q8 UDQ4K DS4
Qwen · nazeshinjite
Params180B
Context256K
Smallest202.5 GB
Vision
LT
LTX 2.3
Ltx · MakiAi
Params21B
Context—
Q4_K_M14.3 GB
GGUF
KA
Karakuri Lm 70b Chat v0.1
Karakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
GGUF
QW
Qwen2.5 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
LL
grok oss Revenant 8B
Llama · c4tdr0ut
Params8.03B
Context128K
Smallest5.7 GB
Tool use
QW
Tiny Agent a 3B
Qwen · driaforall
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
ME
Google_Medgemma 27b Text It
Medgemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
FL
flux.1 lite 8B
Flux · Green-Sky
Params8.16B
Context—
Smallest2.9 GB
GGUF
PA
Pasta PrimaMaid 7b
Pasta · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
GGUF
HU
Huihui LFM2 8B A1B Abliterated
Huihui · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · tiiuae
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
CA
Captain Eris Violet V0.420 12B
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB
GGUF

Keep browsing