GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
bge m3
BGE · cstr
Params567M
Context8K
Smallest0.4 GB
Embedding
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
GP
Codette-Ultimate-V4
gpt-oss · Raiff1982
Params32B
Context128K
Q4_K_M19.4 GB
Reasoning
NU
NuExtract 2.0 8B
Nuextract · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
LI
Ming Image 0.1 Design
Ling · voltaire321
Params6.15B
Context—
Smallest6.5 GB
GGUF
LL
DevQuasar R1 Uncensored Llama 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
LlamaForecaster 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest98.8 GB
GGUF
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
GGUF
KW
KwaiCoder DS V2 Lite Base
Kwaicoder · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
LightGPT 0.5B Qwen2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
Tool use
RI
Ring Lite Distill Preview
Ring · mradermacher
Params16.8B
Context16K
Q4_K_M11.2 GB
Reasoning
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
IN
InnoSpark 7B 0715
Innospark · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
MiMo V2.6 Distill Qwen 9B NVFP4
Qwen · prithivMLmods
Params9.2B
Context256K
Smallest7.0 GB
CodingReasoningTool use
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3.5 mini 3.8b instruct
Phi · lm-kit
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
Gemma 4 Rust Coder
Gemma · Titaniumclock
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
AS
astrollama 3 8b base aic
Astrollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
GGUF
PH
Phi 3 mini 128k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GL
GLM-4.5-Air
GLM · ggml-org
Params107B
Context128K
Q4_K_M63.6 GB
ReasoningTool use
ON
oneirogen-0.5B
Oneirogen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
MI
Midm 2.0 Base Instruct
Midm · gchrisoh
Params11.5B
Context32K
Q4_K_M7.0 GB
Tool use
LI
Ling 3.0 Tiny
Ling · Ninnix96
Params7.89B
Context128K
Smallest5.1 GB
ReasoningTool use
KI
Kimi Dev 72B
Kimi · gabriellarson
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
LL
llama 3.1 medprm reward v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Midm 2.0 Base Instruct 128K
Midm · mradermacher
Params11.5B
Context128K
Q4_K_M7.0 GB
Tool use

Keep browsing