GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
OP
Openhands Lm 32b v0.1
Openhands · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
BG
bge-small-en-v1.5
BGE · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
GL
zai org GLM 5.1
GLM · bartowski
Params754B
Context198K
Q4_K_M459.7 GB
ME
steve-cse_mellogpt
Mellogpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SK
Skywork Skywork R1V3 38B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · bartowski
Params85B
Context128K
Q4_K_M56.6 GB
EG
Ege 8b 1.1
Ege · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · webmp3
Params8.95B
Context256K
Smallest4.1 GB
ZE
zephyr 7b alpha
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kimi Linear REAP 35B A3B Instruct i1
Kimi · mradermacher
Params35B
Context1024K
Q4_K_M21.3 GB
OP
Openhands Lm 1.5b v0.1
Openhands · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
GLM 4.7 Flash REAP 23B A3B absolute heresy
GLM · MuXodious
Params23B
Context198K
Q4_K_M13.9 GB
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · Lucebox
Params14.2B
Context—
Smallest4.9 GB
PH
Phi 3.1 mini 4k instruct
Phi · lmstudio-community
Params3.82B
Context4K
Q4_K_M2.4 GB
AS
astrollama 2 70b base aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GL
GLM4 9B Neon v2
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
NO
notus 7b v1
Notus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
vicgalle Configurable Janus 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Mammoth 1
Mammoth · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
LL
TransLLaMA2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
WH
whisper base
Whisper · oxide-lab
Params73M
Context—
Smallest0.0 GB
DE
DeepSeek V3 0324
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M404.4 GB
AU
AutoGLM Phone 9B
Autoglm · ggml-org
Params9.4B
Context64K
Q4_K_M6.2 GB