GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Indian law chat minor project
Indian · varma007ut
Params6.74B
Context4K
Smallest7.2 GB
GGUF
FI
Fireship GPT v1 i1
Fireship · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.5 9B Uncensored
Ornith · bowmanslayer
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
PH
Phi 3 mini 4k grammar correction
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · RDson
Params14B
Context128K
Q4_K_M8.6 GB
Coding
DE
Fathom-R1-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B Japanese Chat
DeepSeek · flypg
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GL
GLM 5.2 0.8B A0.8B
GLM · mradermacher
Params850M
Context1024K
Q4_K_M0.6 GB
ReasoningTool use
GL
GLM 5.3 Flash
GLM · PaoAI
Params321B
Context1024K
Smallest77.1 GB
ReasoningTool use
GL
Huihui GLM 4.7 Flash Abliterated
GLM · cs2764
Params29.9B
Context198K
Smallest24.6 GB
GGUF
LL
Diffusion Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AT
Athena 1 14B i1
Athena · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
SA
Saul 7B Instruct v1 i1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 4 o1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
XiaomiMiMo.MiMo V2 Flash
Mimo · DevQuasar
Params309B
Context256K
Q4_K_M186.8 GB
ReasoningTool use
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
Phi 4 Mini Reasoning
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
MI
MiMo-V2.6-Pro-MOPD
Mimo · pcuenq
Params1020B
Context1024K
Smallest2.1 GB
Vision
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
PH
phi 3.5 AI Vtuber json
Phi · Navpy
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
US
UserRepGen 4B
Userrepgen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
OR
Ornith-1.5-35B
Ornith · poisonxa
Params35.5B
Context256K
Smallest19.6 GB
ReasoningTool use
QW
PAPO G H Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
PH
shisa v1 phi3 14b
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
ReForm SFT 0.5B
Reform · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
CH
Chocolatine 14B Instruct DPO v1.3 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GU
GUI Owl 1.5 32B Instruct
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
AR
LiberalMind_v1.5
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning

Keep browsing