GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
Tool use
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
Coding
OR
Ornith-1.5-35B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
GGUF
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
LI
Ling 3.0 flash abliterated APEX
Ling · SC117
Params127B
Context256K
Smallest60.4 GB
Reasoning
CY
Cyber Tiel Coder 35B A3B MTP TTQ
Cyber · TokenTinkerer
Params35.5B
Context256K
Q4_K_M21.6 GB
CodingReasoningTool use
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
TE
tensor bank
Tensor · gguf-org
Params—
Context—
Q4_K_M0.0 GB
GGUF
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
Embedding
QW
UnifiedReward Edit Qwen35 27b
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
Coding
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
OR
Ornith 1.5 35B A3B uncensored
Ornith · ressl
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
FR
FrogNano 4B 2609
Frognano · NANI-Nithin
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingVision
WH
whisper large v3 turbo
Whisper · oxide-lab
Params809M
Context—
Smallest0.3 GB
GGUF
GL
Glm-4.1V-9B-Thinking
GLM · unsloth
Params9.4B
Context64K
Q4_K_M6.2 GB
ReasoningVision
GU
GUI Owl 1.5 2B Instruct
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
Vision
PH
phi-4-mini-instruct
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · AtomicChat
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
SA
SaulLM 54B Instruct i1
Saullm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 FP8
DeepSeek · AMAImedia
Params748B
Context1024K
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
AP
cantina-security/apex-flash-1-abliterated
Apex · freakyskittle
Params320B
Context1024K
Q4_K_M193.4 GB
Vision
DE
DeepSeek R1 Qwen3 8B heretic
DeepSeek · saidutta69
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
MI
Mimo-Vl-7B-Rl
Mimo · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Keep browsing