GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NY
Nyanade Stunna Maid 7B v0.2 GGUF IQ Imatrix
Nyanade · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
OP
OpenELM 1_1B
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
RU
RusMind 4.5.2 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
HE
HelpingAI 3B hindi
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Guile
Params177B
Context256K
Q4_K_M119.6 GB
Vision
EI
Einstein v5 v0.2 7B i1
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LF
LFM2.5 2.6B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
ReasoningTool use
FL
Flux 3 Klein
Flux · molbal
Params5.54B
Context—
Q4_K_M3.1 GB
GGUF
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
GGUF
OP
OpenELM 3B Instruct
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
GGUF
GE
lemon mint gemma ko 7b it v0.40
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
MathSmith HC Qwen3 14B ShortCoT
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
LF
LFM2.5 VL 3B heretic
Lfm · saidutta69
Params2.7B
Context32K
Q4_K_M1.7 GB
CodingReasoningTool use
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
CodingTool use
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
magnum 32b v1 i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.8 Flash Next DACAN
Qwen · tirex2001
Params4.95B
Context256K
Smallest6.0 GB
ReasoningTool use
FA
Falcon-H1R-7B
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
TX
Txgemma 27b Chat
Txgemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · pugant
Params177B
Context256K
Smallest81.5 GB
GGUF
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FL
FLUX.1 Krea dev
Flux · markury
Params11.9B
Context—
Smallest6.8 GB
GGUF
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
WA
wavecoder ultra 6.7b
Wavecoder · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
MI
MiniMax M2.1 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
ReasoningTool use
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF

Keep browsing