GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
MS3.2 PaintedFantasy v4.1 24B Heretic v1
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
GA
gaggle-nanochat-pretrained-climbmix-20260924
Gaggle · castorini
Params3.3B
Context2K
Q4_K_M2.6 GB
Coding
FU
FusionNet_34Bx2_MoE
Fusionnet · mradermacher
Params60.8B
Context32K
Q4_K_M36.7 GB
GGUF
GP
GPT4chan 8B
Gpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · 234-45Qq
Params1.78B
Context128K
Smallest1.3 GB
Reasoning
FI
a fixed output model
Fixed · lijie1228
Params—
Context8K
Q4_K_M0.0 GB
GGUF
BI
BiRefNet_lite
Birefnet · Acly
Params220M
Context—
Smallest0.1 GB
GGUF
CH
Chocolatine 14B Instruct DPO v1.1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Zero BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
Reasoning
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v1
Bluestar · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
OP
OpenSeeker v1 30B SFT
Openseeker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
YI
Faro Yi 9B 200K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.6 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LO
LongSeeker 30B SFT
Longseeker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
GGUF
GL
cerebras/GLM-4.6-REAP-268B-A32B
GLM · unsloth
Params269B
Context198K
Q4_K_M162.5 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
CA
CalmeRys 78B Orpo v0.1
Calmerys · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
GL
GLM 4.7 Flash Abliteratex
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
GL
GLM 4.5 Air REAP 82B A12B heretic
GLM · jtl11
Params82B
Context128K
Q4_K_M53.9 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
GT
gte-large
Gte · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
PH
Phi Bode
Phi · dagbs
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
FA
Fara 7B
Fara · prithivMLmods
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
PH
Phi 3 medium 4k instruct
Phi · second-state
Params14B
Context4K
Q4_K_M8.6 GB
Coding
HU
Huihui Fara 7B Abliterated
Huihui · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen 3 14B Gemini v0.1
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing