GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
FA
Fara1.5 9B
Fara · Tdamre
Params9B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
LL
TransLLaMA2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
0pen
Gemma · 0penAGI
Params7.46B
Context128K
Smallest0.9 GB
MI
mistral orpo alpha
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
FR
Franqwenstein 35b
Franqwenstein · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · ubergarm
Params10.7B
Context256K
Smallest3.3 GB
ZE
zephyr 7b beta
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
MS3.2 PaintedFantasy v4.1 24B Ultra Uncensored Heretic v1
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
GL
GLM 4.7 Flash REAP 23B A3B i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
UP
upass tm
Upass · rmaapk
Params—
Context—
Smallest0.0 GB
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
FR
FrogNano 4B 2609 heretic
Frognano · richardyoung
Params4.2B
Context256K
Q4_K_M2.7 GB
AS
astrollama 2 70b chat aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
UM
CENTAURUS Engine v1 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
Apriel-1.5-15B-Thinker
Apriel · unsloth
Params14.4B
Context256K
Q4_K_M8.8 GB
PH
Phi 3 mini 4k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
OP
knoveleng Open RS3
Open · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
MA
MAmmoTH 13B
Mammoth · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB