GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
KI
Kimi VL A3B Thinking 2506
Kimi · ggml-org
Params16B
Context128K
Q4_K_M10.5 GB
GL
GLM 4 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
OR
RegesCore 1.0 35
Ornith · iBossonline
Params34.7B
Context256K
Q4_K_M22.1 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
MA
MangaLMM
Mangalmm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
LL
dolphin-llama3-zh-cn-uncensored
Llama · stephenlzc
Params8B
Context8K
Q4_K_M4.9 GB
JI
JiRackUltra_32b
Jirackultra · CMSManhattan
Params32.8B
Context128K
Q4_K_M19.9 GB
PY
Pyrex 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
OR
Ornith-1.5-35B
Ornith · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB
GD
GDP 4B
Gdp · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
KR
krea2 turbo uncensored v1.1 BACKUP
Krea · Quiho
Params12.8B
Context—
Q4_K_M7.2 GB
SI
Silero VAD v6.2
Silero · handy-computer
Params—
Context—
Smallest0.0 GB
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
LL
llm4decompile 9b v2
Llm · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
JI
JiRackUltra 7b
Jirackultra · CMSManhattan
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · Fbjfhvgv
Params7.62B
Context32K
Q4_K_M4.7 GB
MO
Moonlight 16B A3B Instruct
Moonlight · mmnga
Params16B
Context8K
Q4_K_M10.5 GB
FR
FrogNano 4B Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB