GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
NU
NuExtract i1
Nuextract · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
OC
OceanGPT Basic 7B v0.3
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DI
Discord Micae Hermes 3 3B abliterated i1
Discord · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
PH
phi 4
Phi · second-state
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
ZE
zelensky 78b i1
Zelensky · mradermacher
Params78B
Context96K
Smallest24.3 GB
ReasoningTool use
QW
Qwen2 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
DI
Diff Llm
Diff · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
ME
MedVAL 4B
Medval · stanfordmimi
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash Vision Exp Q8 0 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context1024K
Smallest128.0 GB
GGUF
GL
GLM 5_4layer
GLM · mradermacher
Params13B
Context198K
Q4_K_M8.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MA
Matricide 12B Unslop Unleashed i1
Matricide · BasedAGI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Chicka Mixtral 3x7b i1
Mistral · mradermacher
Params18.5B
Context8K
Q4_K_M11.2 GB
GGUF
PH
Phil 18B Il1
Phil · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
Coding
GD
Saul Instruct v1
Gdpr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.5 9B DFlash
Ornith · el4
Params1.29B
Context256K
Smallest1.1 GB
ReasoningTool use
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
PH
Phi 4 Mirage Sol Reasoning 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
NU
NuExtract 1.5 tiny
Nuextract · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3 Next 480E Abliterated Instruct
Qwen · mradermacher
Params74.8B
Context256K
Q4_K_M45.5 GB
Tool use
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
QW
FBK_Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
RE
ReasonFlux Coder 4B
Reasonflux · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
CodingReasoningTool use
FI
Fine R1 7B
Fine · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
PH
phi4 MedIT 10B o1
Phi · mkurman
Params10.3B
Context16K
Smallest10.9 GB
Coding
QW
UnifiedReward 2.0 Qwen 3b
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
MU
Murasaki APE Aligner 2B
Murasaki · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
LL
r1 1776 distill llama 70b
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
MI
MiMo V2.6 Flash MOPD
Mimo · AMAImedia
Params310B
Context1024K
Smallest96.7 GB
ReasoningTool useVision
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF

Keep browsing