GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
CodeMaster v1 7b
Codemaster · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
VI
VibeVoice-1.5B
Vibevoice · cstr
Params2.7B
Context—
Smallest1.9 GB
GGUF
BE
Beck 4B
Beck · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
DA
Dans PersonalityEngine V1.2.0 24B i1
Dans · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GL
GLM 4.6V Flash Heretic
GLM · ZuzeTt
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Vision
MI
zephyr 7b beta Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith-1.5-35B
Ornith · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
ST
STELLA VLM JoVE 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
NE
NextCoder 32B
Nextcoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MO
moonshine-streaming-tiny
Moonshine · cstr
Params44M
Context—
Smallest0.0 GB
GGUF
CR
CroissantLLMBase
Croissantllmbase · mradermacher
Params1.35B
Context2K
Q4_K_M0.9 GB
Coding
PH
luvGPT phi3 uncensored chat
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Roleplay
HE
HelpingAI Lite
Helpingai · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
YO
Youtu FT V1 35B A3B
Youtu · gatilin
Params34.7B
Context256K
Smallest21.2 GB
ReasoningTool use
GL
GLM 4.7 Flash Absolute Heresy
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
OC
OceanGPT Basic 7B
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
HI
HiDream I1 Dev
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
HU
Huihui MiroThinker v1.5 30B Abliterated
Huihui · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
GL
GLM 4.7 Flash REAP 23B A3B absolute heresy i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
KU
kugelaudio 0 open
Kugelaudio · cstr
Params8.64B
Context—
Smallest5.7 GB
GGUF
SA
SaulLM 54B Instruct
Saullm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
UM
CENTAURUS Components v2 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
GLM-5.3-Flash
GLM · 6block
Params313B
Context1024K
Smallest70.7 GB
ReasoningTool use
GL
GLM 4.7 Flash
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
OR
Ornith 1.5 35B A3B MXFP4
Ornith · tsaipifong
Params35.5B
Context—
Smallest0.4 GB
GGUF

Keep browsing