GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash
DeepSeek · Lucebox
Params755B
Context—
Smallest355.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx t16
DeepSeek · lxe
Params—
Context—
Smallest251.6 GB
GGUF
MI
Ming 3.0 Audio Tiny
Ming · audio-cpp
Params—
Context—
Smallest10.0 GB
GGUF
GL
GLM 5.3 UNCENSORED FP8
GLM · softwareweaver
Params753B
Context1024K
Q4_K_M454.6 GB
GGUF
PI
Pixal3D
Pixal · vegax87
Params—
Context—
Smallest0.0 GB
GGUF
OR
Ornith 1.5 122B UNCENSORED
Ornith · dealignai
Params125B
Context256K
Q4_K_M79.4 GB
Vision
QW
Abliterated MiMo V2.6 Distill Qwen 9B
Qwen · BoldingBuilds
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
MiMo V2.6 Flash MOPD
Mimo · spiritfather
Params310B
Context1024K
Q4_K_M189.5 GB
GGUF
GL
GLM-5.3-Flash
GLM · DogContext
Params321B
Context1024K
Smallest96.5 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · orcarouter
Params321B
Context1024K
Q4_K_M193.0 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash 1017 XQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · AtomicChat
Params755B
Context—
Smallest365.7 GB
GGUF
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
GGUF
OR
Ornith 1.5 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
OR
Ornith-1.5-122B
Ornith · AtomicChat
Params125B
Context256K
Smallest35.0 GB
ReasoningTool useVision
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
Vision
LF
LFM2.5-350M
Lfm · weareapexcreators
Params354M
Context125K
Smallest0.4 GB
GGUF
GI
GigaChat3.1 10B A1.8B
Gigachat · ai-sage
Params10.7B
Context256K
Q4_K_M6.5 GB
Tool use
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB
GGUF
MI
Ming 3.0 TTS 0.5B
Ming · audio-cpp
Params1.6B
Context—
Smallest1.7 GB
GGUF
LF
LFM2.5 230M LocalAI
Lfm · weareapexcreators
Params230M
Context125K
Smallest0.2 GB
GGUF
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
GGUF
LF
LFM2.5 1.2B Instruct LocalAI
Lfm · weareapexcreators
Params1.17B
Context125K
Smallest1.2 GB
GGUF
GL
GLM 4.6V Flash
GLM · ggml-org
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
PI
PII Tracer
Pii · perplexity-ai
Params596M
Context32K
Smallest1.2 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
GGUF
GL
GLM 4.6V
GLM · ggml-org
Params107B
Context128K
Q4_K_M70.4 GB
Vision
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
GGUF

Keep browsing