GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
NU
NuExtract i1
Nuextract · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
OC
OceanGPT Basic 7B v0.3
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DI
Discord Micae Hermes 3 3B abliterated i1
Discord · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
PH
phi 4
Phi · second-state
Params14.7B
Context16K
Q4_K_M9.1 GB
ZE
zelensky 78b i1
Zelensky · mradermacher
Params78B
Context96K
Smallest24.3 GB
QW
Qwen2 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DI
Diff Llm
Diff · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
ME
MedVAL 4B
Medval · stanfordmimi
Params4.02B
Context40K
Q4_K_M2.5 GB
DE
DeepSeek V4 Flash Vision Exp Q8 0 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context1024K
Smallest128.0 GB
GL
GLM 5_4layer
GLM · mradermacher
Params13B
Context198K
Q4_K_M8.4 GB
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
MA
Matricide 12B Unslop Unleashed i1
Matricide · BasedAGI
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Chicka Mixtral 3x7b i1
Mistral · mradermacher
Params18.5B
Context8K
Q4_K_M11.2 GB
PH
Phil 18B Il1
Phil · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
GD
Saul Instruct v1
Gdpr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.5 9B DFlash
Ornith · el4
Params1.29B
Context256K
Smallest1.1 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
PH
Phi 4 Mirage Sol Reasoning 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
NU
NuExtract 1.5 tiny
Nuextract · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 Next 480E Abliterated Instruct
Qwen · mradermacher
Params74.8B
Context256K
Q4_K_M45.5 GB
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
QW
FBK_Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
RE
ReasonFlux Coder 4B
Reasonflux · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
FI
Fine R1 7B
Fine · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
phi4 MedIT 10B o1
Phi · mkurman
Params10.3B
Context16K
Smallest10.9 GB
QW
UnifiedReward 2.0 Qwen 3b
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
MU
Murasaki APE Aligner 2B
Murasaki · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
r1 1776 distill llama 70b
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiMo V2.6 Flash MOPD
Mimo · AMAImedia
Params310B
Context1024K
Smallest96.7 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB