GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Mistral Small Gutenberg Doppel 22B
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
WI
Wizard Vicuna 7B Uncensored
Wizard · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
Hebrew Gemma 11B Instruct
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
QW
Qwen2.5 VL 7B RLVR ReasoningOnly ThinkLite
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LF
LFM2 24B A2B Heretic Ara
Lfm · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
WI
WizardLM 13B V1.0 Uncensored
Wizardlm · second-state
Params13B
Context2K
Q4_K_M7.9 GB
JE
Jellyfish-13B
Jellyfish · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LT
LTX 2.3
Ltx · Viral2AI
Params21B
Context—
Q4_K_M14.3 GB
WH
Whispernow Lfm2.5 2.6b
Whispernow · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen.Qwen2.5 3B Instruct
Qwen · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
ER
Eris PrimeV4 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phi 1 5
Phi · TKDKid1000
Params1.42B
Context2K
Q4_K_M0.9 GB
LO
LongWriter V 7B i1
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OM
Sakura d1 omni 600M HighQuality
Omni · webmp3
Params381M
Context125K
Smallest0.0 GB
QW
Eve Qwen2.5 3b Consciousness Soul
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
NF
NFT 32B
Nft · gabriellarson
Params32.8B
Context128K
Q4_K_M19.9 GB
ZE
Zephyr-3.43B
Zephyr · afrideva
Params3.43B
Context4K
Q4_K_M2.1 GB
FA
Falcon H1 0.5B Instruct
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
HU
Huihui EXAONE Deep 7.8B Abliterated
Huihui · mradermacher
Params7.82B
Context32K
Q4_K_M4.8 GB
LF
LFM2.5 8B A1B UltraCoder L3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GP
lilloukas_gplatty-30b
Gplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
CodeQwen1.5 7B
Qwen · mradermacher
Params7.25B
Context64K
Q4_K_M4.7 GB
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
MI
Mistral Large Instruct 2407
Mistral · lmstudio-community
Params123B
Context128K
Q4_K_M73.2 GB
SC
Scope Guard v2 4B Q 2609
Scope · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ST
stablelm-2-1_6b
Stablelm · afrideva
Params1.64B
Context4K
Q4_K_M1.0 GB
QW
Qwen3 4B
Qwen · second-state
Params4.02B
Context40K
Q4_K_M2.5 GB
OM
Omega Darker Gaslight_The Final Forgotten Fever Dream 24B
Omega · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB