GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kimi VL A3B Thinking 2506
Kimi · ggml-org
Params16B
Context128K
Q4_K_M10.5 GB
ReasoningVision
GL
GLM 4 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
OR
RegesCore 1.0 35
Ornith · iBossonline
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningVision
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
MA
MangaLMM
Mangalmm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
Coding
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
Embedding
LL
dolphin-llama3-zh-cn-uncensored
Llama · stephenlzc
Params8B
Context8K
Q4_K_M4.9 GB
Coding
JI
JiRackUltra_32b
Jirackultra · CMSManhattan
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
PY
Pyrex 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
Vision
OR
Ornith-1.5-35B
Ornith · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
GD
GDP 4B
Gdp · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
KR
krea2 turbo uncensored v1.1 BACKUP
Krea · Quiho
Params12.8B
Context—
Q4_K_M7.2 GB
GGUF
SI
Silero VAD v6.2
Silero · handy-computer
Params—
Context—
Smallest0.0 GB
GGUF
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
GGUF
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
Vision
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
LL
llm4decompile 9b v2
Llm · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GGUF
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
JI
JiRackUltra 7b
Jirackultra · CMSManhattan
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · Fbjfhvgv
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
MO
Moonlight 16B A3B Instruct
Moonlight · mmnga
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
FR
FrogNano 4B Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingRoleplayTool use

Keep browsing