GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Small Gutenberg Doppel 22B
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
WI
Wizard Vicuna 7B Uncensored
Wizard · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GE
Hebrew Gemma 11B Instruct
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
GGUF
QW
Qwen2.5 VL 7B RLVR ReasoningOnly ThinkLite
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
LF
LFM2 24B A2B Heretic Ara
Lfm · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
Tool use
WI
WizardLM 13B V1.0 Uncensored
Wizardlm · second-state
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
JE
Jellyfish-13B
Jellyfish · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LT
LTX 2.3
Ltx · Viral2AI
Params21B
Context—
Q4_K_M14.3 GB
GGUF
WH
Whispernow Lfm2.5 2.6b
Whispernow · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
QW
Qwen.Qwen2.5 3B Instruct
Qwen · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ER
Eris PrimeV4 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
PH
phi 1 5
Phi · TKDKid1000
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
LO
LongWriter V 7B i1
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
OM
Sakura d1 omni 600M HighQuality
Omni · webmp3
Params381M
Context125K
Smallest0.0 GB
GGUF
QW
Eve Qwen2.5 3b Consciousness Soul
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
NF
NFT 32B
Nft · gabriellarson
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
ZE
Zephyr-3.43B
Zephyr · afrideva
Params3.43B
Context4K
Q4_K_M2.1 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
Tool use
HU
Huihui EXAONE Deep 7.8B Abliterated
Huihui · mradermacher
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
LF
LFM2.5 8B A1B UltraCoder L3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
GP
lilloukas_gplatty-30b
Gplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
CodeQwen1.5 7B
Qwen · mradermacher
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
MI
Mistral Large Instruct 2407
Mistral · lmstudio-community
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
SC
Scope Guard v2 4B Q 2609
Scope · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
ST
stablelm-2-1_6b
Stablelm · afrideva
Params1.64B
Context4K
Q4_K_M1.0 GB
Coding
QW
Qwen3 4B
Qwen · second-state
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OM
Omega Darker Gaslight_The Final Forgotten Fever Dream 24B
Omega · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay

Keep browsing