GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
OR
Ornith 1.0 9B Uncensored
Ornith · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
GT
gte-large
Gte · opaninakuffo
Params334M
Context512
Smallest0.7 GB
GL
GLM-ASR-Nano
GLM · cstr
Params2.26B
Context—
Smallest1.3 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
GL
Huihui GLM 5.2 abliterated
GLM · huihui-ai
Params754B
Context1024K
Smallest211.1 GB
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama Phi 3 DoRA i1
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
US
UserRepGen 4B
Userrepgen · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
LI
Ling 3.0 flash Sante Uncensored
Ling · AtomicChat
Params127B
Context256K
Smallest61.1 GB
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
FA
Fara 7B
Fara · gguf-org
Params7.62B
Context125K
Q4_K_M4.7 GB
OR
Ornith 1.0 9B heretic MTP
Ornith · SC117
Params456M
Context256K
Q4_K_M5.8 GB
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB