GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · dealignai
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningVision
PH
Phi 4 Mini Instruct
Phi · MaziyarPanahi
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
Vision
GL
Glm-4.5-Air
GLM · unsloth
Params110B
Context128K
Q4_K_M73.0 GB
GGUF
SO
Models Upstage Solar Pro Preview Instruct
Solar · MaziyarPanahi
Params22B
Context4K
Q4_K_M13.3 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
VI
VibeVoice-7B
Vibevoice · audio-cpp
Params7B
Context—
Smallest10.6 GB
GGUF
GL
GLM 5.3 Flash GGUF DGX Spark
GLM · autotrust
Params279B
Context1024K
Smallest84.9 GB
GGUF
OR
Ornith 1.5 9B
Ornith · AtomicChat
Params8.95B
Context256K
Smallest2.8 GB
ReasoningTool useVision
GL
Glm-4.6V-Flash
GLM · unsloth
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
DE
Models Deepseek Ai DeepSeek R1 0528 Qwen3 8B
DeepSeek · MaziyarPanahi
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DE
DeepSeek V3 0324
DeepSeek · MaziyarPanahi
Params671B
Context160K
Smallest133.6 GB
GGUF
PH
phi 4
Phi · MaziyarPanahi
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · Hikari07jp
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
DE
DeepSeek V4.1 Flash UNCENSORED
DeepSeek · Adolphsson
Params748B
Context—
Q4_K_M426.1 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · jcuypers
Params474M
Context256K
Q4_K_M0.3 GB
GGUF
OR
Ornith 1.5 9B UNCENSORED
Ornith · dealignai
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
PH
Phi 3.5 Mini Instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GL
Glm 5.3 Flash Reap50 Fp8 Pass2
GLM · patrickbdevaney
Params165B
Context1024K
Q4_K_M99.3 GB
ReasoningTool useVision
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
GGUF
MI
Mimo-V2-Flash
Mimo · unsloth
Params310B
Context256K
Q4_K_M186.8 GB
GGUF
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · DavidAU
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
GI
GigaAM v3 E2E-CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
GGUF
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
CodingReasoning
GL
Zai org_GLM 4.7 Flash
GLM · lmstudio-community
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED
GLM · AliceThirty
Params320B
Context1024K
Smallest108.7 GB
Vision
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · orcarouter
Params748B
Context1024K
Smallest1.6 GB
ReasoningTool useVision
ST
stock report2
Stock · uiyong
Params—
Context—
Smallest0.0 GB
GGUF
KA
Karna 49M SFT Model
Karna · VarunHujan
Params72M
Context2K
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 ROCMFP
DeepSeek · Lucebox
Params755B
Context—
Smallest4.9 GB
GGUF

Keep browsing