GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kimi Linear 48B A3B Instruct
Kimi · ymcki
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
NE
NextCoder 7B Finetuned
Nextcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CH
chinese light novel 40k
Chinese · listenrwt
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CL
clip-vit-large-patch14/
Clip · mys
Params428M
Context—
Smallest0.1 GB
GGUF
KO
Koto Small 7b Rc1
Koto · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
KW
Kwaipilot.KwaiCoder DS V2 Lite Base
Kwaicoder · csabakecskemeti
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
CH
ChatFrame i1
Chatframe · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
SRFT Qwen2.5 Math 7B
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
Reasoning
AZ
Azzurro i1
Azzurro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
GLM Z1 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
CO
cosmosage-v3
Cosmosage · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
CA
Caliburn 12b
Caliburn · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GGUF
DE
DeepMath Zero Math 7B
Deepmath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
LL
LEMA Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 Hermes Instruct 1.5B
Qwen · koshuro
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
FL
FluentlyQwen2.5 32B i1
Fluentlyqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningRoleplay
PH
Barcenas 14b phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MA
Magma 8B Modified
Magma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
GL
GLM 4.7 Flash Heretic 1.2.0
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
ZE
zephyr quiklang 3b
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
DE
Janus Pro 1B
DeepSeek · Websitedeveloper
Params1.65B
Context16K
Q4_K_M1.0 GB
Vision
LI
LiteCoder 30B A3B Terminal SFT
Litecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
ST
state-0
State · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DA
dac 44khz
Dac · cstr
Params54M
Context—
Smallest0.1 GB
GGUF
MI
mistral small 24b
Mistral · cortexso
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · aisingapore
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
DE
DeepCode 7B Aurora
Deepcode · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
LL
OpenBioLLM Llama3 8B
Llama · aaditya
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing