GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
GGUF
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool useVision
OP
Openhands Lm 32b v0.1
Openhands · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
BG
bge-small-en-v1.5
BGE · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
Embedding
GL
zai org GLM 5.1
GLM · bartowski
Params754B
Context198K
Q4_K_M459.7 GB
GGUF
ME
steve-cse_mellogpt
Mellogpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SK
Skywork Skywork R1V3 38B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Vision
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · bartowski
Params85B
Context128K
Q4_K_M56.6 GB
GGUF
EG
Ege 8b 1.1
Ege · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · webmp3
Params8.95B
Context256K
Smallest4.1 GB
Vision
ZE
zephyr 7b alpha
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kimi Linear REAP 35B A3B Instruct i1
Kimi · mradermacher
Params35B
Context1024K
Q4_K_M21.3 GB
GGUF
OP
Openhands Lm 1.5b v0.1
Openhands · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GL
GLM 4.7 Flash REAP 23B A3B absolute heresy
GLM · MuXodious
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · Lucebox
Params14.2B
Context—
Smallest4.9 GB
GGUF
PH
Phi 3.1 mini 4k instruct
Phi · lmstudio-community
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
AS
astrollama 2 70b base aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GL
GLM4 9B Neon v2
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
NO
notus 7b v1
Notus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
vicgalle Configurable Janus 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Mammoth 1
Mammoth · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
Embedding
LL
TransLLaMA2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WH
whisper base
Whisper · oxide-lab
Params73M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V3 0324
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M404.4 GB
GGUF
AU
AutoGLM Phone 9B
Autoglm · ggml-org
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision

Keep browsing