GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NY
Nyanade Stunna Maid 7B v0.2 GGUF IQ Imatrix
Nyanade · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
OP
OpenELM 1_1B
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
RU
RusMind 4.5.2 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
HE
HelpingAI 3B hindi
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Qwen3.8 Flash Next
Qwen · Guile
Params177B
Context256K
Q4_K_M119.6 GB
EI
Einstein v5 v0.2 7B i1
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
LFM2.5 2.6B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
FL
Flux 3 Klein
Flux · molbal
Params5.54B
Context—
Q4_K_M3.1 GB
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
OP
OpenELM 3B Instruct
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
GE
lemon mint gemma ko 7b it v0.40
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
MathSmith HC Qwen3 14B ShortCoT
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LF
LFM2.5 VL 3B heretic
Lfm · saidutta69
Params2.7B
Context32K
Q4_K_M1.7 GB
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
magnum 32b v1 i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
QW
Qwen3.8 Flash Next DACAN
Qwen · tirex2001
Params4.95B
Context256K
Smallest6.0 GB
FA
Falcon-H1R-7B
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
TX
Txgemma 27b Chat
Txgemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3.8 Flash Next
Qwen · pugant
Params177B
Context256K
Smallest81.5 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
FL
FLUX.1 Krea dev
Flux · markury
Params11.9B
Context—
Smallest6.8 GB
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
WA
wavecoder ultra 6.7b
Wavecoder · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
MI
MiniMax M2.1 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB