GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
OR
Ornith 1.0 9B Uncensored
Ornith · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GT
gte-large
Gte · opaninakuffo
Params334M
Context512
Smallest0.7 GB
GGUF
GL
GLM-ASR-Nano
GLM · cstr
Params2.26B
Context—
Smallest1.3 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
ReasoningTool use
GL
Huihui GLM 5.2 abliterated
GLM · huihui-ai
Params754B
Context1024K
Smallest211.1 GB
GGUF
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
LL
Llama Phi 3 DoRA i1
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
GGUF
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
US
UserRepGen 4B
Userrepgen · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
GGUF
LI
Ling 3.0 flash Sante Uncensored
Ling · AtomicChat
Params127B
Context256K
Smallest61.1 GB
ReasoningTool use
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
FA
Fara 7B
Fara · gguf-org
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OR
Ornith 1.0 9B heretic MTP
Ornith · SC117
Params456M
Context256K
Q4_K_M5.8 GB
ReasoningVision
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding

Keep browsing