GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
KI
Kimi Linear 48B A3B Instruct
Kimi · ymcki
Params49.1B
Context1024K
Q4_K_M29.7 GB
NE
NextCoder 7B Finetuned
Nextcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CH
chinese light novel 40k
Chinese · listenrwt
Params8B
Context8K
Q4_K_M4.9 GB
CL
clip-vit-large-patch14/
Clip · mys
Params428M
Context—
Smallest0.1 GB
KO
Koto Small 7b Rc1
Koto · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
KW
Kwaipilot.KwaiCoder DS V2 Lite Base
Kwaicoder · csabakecskemeti
Params15.7B
Context160K
Q4_K_M10.4 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
CH
ChatFrame i1
Chatframe · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
SRFT Qwen2.5 Math 7B
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
AZ
Azzurro i1
Azzurro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
GLM Z1 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
CO
cosmosage-v3
Cosmosage · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CA
Caliburn 12b
Caliburn · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
DE
DeepMath Zero Math 7B
Deepmath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
LEMA Llama 2 7b
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2.5 Hermes Instruct 1.5B
Qwen · koshuro
Params1.54B
Context32K
Q4_K_M1.0 GB
FL
FluentlyQwen2.5 32B i1
Fluentlyqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
PH
Barcenas 14b phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
MA
Magma 8B Modified
Magma · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GL
GLM 4.7 Flash Heretic 1.2.0
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ZE
zephyr quiklang 3b
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
DE
Janus Pro 1B
DeepSeek · Websitedeveloper
Params1.65B
Context16K
Q4_K_M1.0 GB
LI
LiteCoder 30B A3B Terminal SFT
Litecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ST
state-0
State · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
dac 44khz
Dac · cstr
Params54M
Context—
Smallest0.1 GB
MI
mistral small 24b
Mistral · cortexso
Params23.6B
Context32K
Q4_K_M14.3 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · aisingapore
Params32.9B
Context1024K
Q4_K_M25.4 GB
DE
DeepCode 7B Aurora
Deepcode · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
OpenBioLLM Llama3 8B
Llama · aaditya
Params8.03B
Context8K
Q4_K_M4.9 GB