GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
SynthAgent SFT Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LO
Loom Swift Micro 2 Upload
Loom · textilelabs
Params1M
Context2K
Q4_K_M0.0 GB
Tool use
LL
namespace Pt Llama 3 8B Instruct 80K QLoRA Merged
Llama · RichardErkhov
Params8.03B
Context80K
Q4_K_M4.9 GB
GGUF
PH
gguf Phi 3 mini 4k instruct
Phi · Felladrin
Params3.82B
Context4K
Q4_K_M2.7 GB
GGUF
BA
Baanzon Chenni 1.5 9B
Baanzon · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 7B Abliterated Obliteratus
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
SQ
sqlite lembed model examples
Sqlite · asg017
Params23M
Context512
Smallest0.0 GB
Embedding
CH
ChinaLM-9B
Chinalm · mradermacher
Params8.93B
Context4K
Q4_K_M5.5 GB
GGUF
GL
GLM 4 32B 0414 Korean Culture
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
QW
Qwen2.5 7B ARPO
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GG
ggml CLIP ViT H 14 laion2B s32B b79K
Ggml · mys
Params986M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V3 1B Test
DeepSeek · tensorblock
Params1.05B
Context160K
Smallest0.5 GB
Tool use
RE
ReForm SFT 1.5B
Reform · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
QW
UnifiedReward Edit Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
LO
Loom Weave 4
Loom · textilelabs
Params56M
Context32K
Q4_K_M0.0 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
IN
InfiFPO 14B
Infifpo · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
MI
MiMo-VL-7B-RL
Mimo · XiaomiMiMo
Params7.62B
Context125K
Smallest15.3 GB
Tool useVision
DE
DeepSeek V4 Flash 0731
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
QW
Deeepseek QwenSlerp4 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
MI
MiMo Embodied 7B
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
CR
Creativity Lfm2 5 350M
Creativity · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool use
WA
wavecoder ultra 6.7b i1
Wavecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GL
GLM 4.5V
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
ReasoningTool useVision
MM
MM R5 i1
mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
VA
VALOR 8B
Valor · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · hsmorikawa
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Heretic
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
AP
Apriel 1.6 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool use

Keep browsing