GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
Gemma 2 27b It
Gemma · duyntnet
Params27.2B
Context8K
Q4_K_M16.6 GB
IN
Internlm Internlm2_5 7b Chat
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
MI
Riva Translate 4B Instruct v2 imatrix
Mistral · liodon-ai
Params4.2B
Context8K
Q4_K_M2.8 GB
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwen3.5 27B Uncensored Aggressive
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
PS
Psyfighter2 Orca2 13B ties
Psyfighter · tuantran1632001
Params13B
Context4K
Q4_K_M7.9 GB
HE
HelpingAI2 6B
Helpingai · QuantFactory
Params5.85B
Context8K
Q4_K_M3.6 GB
ST
stable diffusion 3.5 medium
Stable · gaianet
Params695M
Context—
Smallest0.1 GB
NE
Nekolyne
Nekolyne · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LI
jayyun98/Ling-3.0-Tiny-DSpark
Ling · StefanoBalocco
Params274M
Context128K
Smallest0.1 GB
AQ
AquilaChat2 34B 16K
Aquilachat · mradermacher
Params33.7B
Context16K
Q4_K_M20.3 GB
LL
Joah-Llama-3-MAAL-MLP-KoEn-8B-Reborn
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
XinYuan Qwen2 7B 0917
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LF
LFM2.5 1.2B Saiga It v3
Lfm · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
EX
EXAONE 4.5 33B
Exaone · mradermacher
Params33.1B
Context256K
Q4_K_M20.0 GB
JA
Jackdaw 30B A3B
Jackdaw · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8 Flash Next Q8 UDQ4K DS4
Qwen · nazeshinjite
Params180B
Context256K
Smallest202.5 GB
LT
LTX 2.3
Ltx · MakiAi
Params21B
Context—
Q4_K_M14.3 GB
KA
Karakuri Lm 70b Chat v0.1
Karakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
QW
Qwen2.5 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
grok oss Revenant 8B
Llama · c4tdr0ut
Params8.03B
Context128K
Smallest5.7 GB
QW
Tiny Agent a 3B
Qwen · driaforall
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
Google_Medgemma 27b Text It
Medgemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
FL
flux.1 lite 8B
Flux · Green-Sky
Params8.16B
Context—
Smallest2.9 GB
PA
Pasta PrimaMaid 7b
Pasta · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
HU
Huihui LFM2 8B A1B Abliterated
Huihui · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
FA
Falcon3 1B Instruct
Falcon · tiiuae
Params1.67B
Context8K
Q4_K_M1.1 GB
CA
Captain Eris Violet V0.420 12B
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB