GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Fara1.5 9B
Fara · Tdamre
Params9B
Context256K
Q4_K_M5.6 GB
Vision
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
CodingReasoningTool use
LL
TransLLaMA2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
0pen
Gemma · 0penAGI
Params7.46B
Context128K
Smallest0.9 GB
GGUF
MI
mistral orpo alpha
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
FR
Franqwenstein 35b
Franqwenstein · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GGUF
GI
GigaChat3 10B A1.8B Bf16
Gigachat · ubergarm
Params10.7B
Context256K
Smallest3.3 GB
GGUF
ZE
zephyr 7b beta
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
MS3.2 PaintedFantasy v4.1 24B Ultra Uncensored Heretic v1
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
GL
GLM 4.7 Flash REAP 23B A3B i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
UP
upass tm
Upass · rmaapk
Params—
Context—
Smallest0.0 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
FR
FrogNano 4B 2609 heretic
Frognano · richardyoung
Params4.2B
Context256K
Q4_K_M2.7 GB
Vision
AS
astrollama 2 70b chat aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
UM
CENTAURUS Engine v1 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AP
Apriel-1.5-15B-Thinker
Apriel · unsloth
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
PH
Phi 3 mini 4k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
GGUF
OP
knoveleng Open RS3
Open · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
MA
MAmmoTH 13B
Mammoth · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing