GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
Qwen SEA LION v4.5 27B IT
Qwen · aisingapore
Params27.3B
Context256K
Q4_K_M16.8 GB
AT
Atomight V2.1 0.5B Inference
Atomight · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
RH
Rho Math 1b v0.1
Rho · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
VA
VALOR 8B
Valor · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
GLM 5.3 Flash
GLM · stealth-model
Params321B
Context1024K
Smallest101.8 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Q4_K_M2.5 GB
BA
Ballpark Trivia XL i1
Ballpark · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
QW
MiMo 7B RL 0530 Qwenified
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ornith 9B
Ornith · AtomicChat
Params8.95B
Context256K
Q4_K_M5.6 GB
RS
RSCoVLM Det 7B 2512
Rscovlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
NE
Nexus 4x7B IKM MLX i1
Nexus · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
FA
Ramanujan Ganit R1 14B
Fathom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B uncensored i1
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
EM
Emollama chat 7b
Emollama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
PH
Phi 4 Mini Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
MA
MAmmoTH2 8B Plus
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ZE
ZeroTTS
Zerotts · zeroweight-ai
Params202M
Context—
Smallest0.1 GB
GL
GLM 4.6V Flash
GLM · prithivMLmods
Params9.4B
Context128K
Q4_K_M6.2 GB
RH
rho math 7b v0.1
Rho · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixture Science BioMistral 7B
Mixture · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KH
Khawarizmi SPI MLP 8B
Khawarizmi · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
AC
ACE Brain 0.6
Ace · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
QW
UnifiedReward 2.0 Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
NE
IQ2 NL IQ3 NL Test Models
Nemotron · eaddario
Params8.89B
Context1024K
Smallest0.0 GB
PH
Phi 4 Open R1 Distill EZOv1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PU
public models
Public · motgame
Params4.63B
Context256K
Q4_K_M2.7 GB
AS
astrollama 3 8b base summary i1
Astrollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB