GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
MO
Moonshine Streaming Small
Moonshine · handy-computer
Params140M
Context—
Smallest0.2 GB
GGUF
BG
bge m3
BGE · lm-kit
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · zerofata
Params107B
Context128K
Smallest65.9 GB
GGUF
SC
SCAIL Preview
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
GGUF
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED NVFP4 DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
Vision
PH
phi 4
Phi · lmstudio-community
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 3 mini 4k instruct update2024 07 03 IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
Coding
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB
GGUF
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
GGUF
LI
Ling 3.0 tiny abliterated APEX
Ling · SC117
Params7.9B
Context128K
Smallest3.4 GB
GGUF
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
Vision
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
PH
Phi 4 Mini Reasoning
Phi · lmstudio-community
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
CY
Cyber Tiel Coder 35B A3B APEX I NanoPlus
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
GGUF
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
OR
Tiel Coder 35B A3B APEX I MiniPlus V2.1
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
CodingReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
LL
ultravox v0 5 llama 3 2 1b
Llama · ggml-org
Params1.24B
Context128K
Q4_K_M0.8 GB
Vision
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision

Keep browsing