GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · dealignai
Params35.5B
Context256K
Q4_K_M21.7 GB
PH
Phi 4 Mini Instruct
Phi · MaziyarPanahi
Params3.84B
Context128K
Q4_K_M2.5 GB
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
GL
Glm-4.5-Air
GLM · unsloth
Params110B
Context128K
Q4_K_M73.0 GB
SO
Models Upstage Solar Pro Preview Instruct
Solar · MaziyarPanahi
Params22B
Context4K
Q4_K_M13.3 GB
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
VI
VibeVoice-7B
Vibevoice · audio-cpp
Params7B
Context—
Smallest10.6 GB
GL
GLM 5.3 Flash GGUF DGX Spark
GLM · autotrust
Params279B
Context1024K
Smallest84.9 GB
OR
Ornith 1.5 9B
Ornith · AtomicChat
Params8.95B
Context256K
Smallest2.8 GB
GL
Glm-4.6V-Flash
GLM · unsloth
Params9.4B
Context128K
Q4_K_M6.2 GB
DE
Models Deepseek Ai DeepSeek R1 0528 Qwen3 8B
DeepSeek · MaziyarPanahi
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V3 0324
DeepSeek · MaziyarPanahi
Params671B
Context160K
Smallest133.6 GB
PH
phi 4
Phi · MaziyarPanahi
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · Hikari07jp
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek V4.1 Flash UNCENSORED
DeepSeek · Adolphsson
Params748B
Context—
Q4_K_M426.1 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · jcuypers
Params474M
Context256K
Q4_K_M0.3 GB
OR
Ornith 1.5 9B UNCENSORED
Ornith · dealignai
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi 3.5 Mini Instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GL
Glm 5.3 Flash Reap50 Fp8 Pass2
GLM · patrickbdevaney
Params165B
Context1024K
Q4_K_M99.3 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
MI
Mimo-V2-Flash
Mimo · unsloth
Params310B
Context256K
Q4_K_M186.8 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · DavidAU
Params29.9B
Context198K
Q4_K_M18.5 GB
GI
GigaAM v3 E2E-CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
GL
Zai org_GLM 4.7 Flash
GLM · lmstudio-community
Params30B
Context198K
Q4_K_M18.1 GB
GL
GLM 5.3 Flash UNCENSORED
GLM · AliceThirty
Params320B
Context1024K
Smallest108.7 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · orcarouter
Params748B
Context1024K
Smallest1.6 GB
ST
stock report2
Stock · uiyong
Params—
Context—
Smallest0.0 GB
KA
Karna 49M SFT Model
Karna · VarunHujan
Params72M
Context2K
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017 ROCMFP
DeepSeek · Lucebox
Params755B
Context—
Smallest4.9 GB