GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
TU
Tulu MathLingo 8B
Tulu · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
badger mu llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
SQ
Sqweeks 7B Instruct
Sqweeks · MaziyarPanahi
Params7.62B
Context8K
Smallest5.3 GB
WI
models--mergekit-community--mergekit-slerp-bzasjyl
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Karen TheEditor V2 STRICT Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Messier Opus 14B Elite12
Messier · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Llama Chat Summary 3.2 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
KO
Kosmos VENN 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen2.5 14B YOYO V5
Qwen · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
PR
Prismatic 12b v0.1 Experimental 1115
Prismatic · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
samantha mistral instruct 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 8B Aifeifei 1.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
BL
Valor 7B v0.1
Blockchainlabs · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
MI
v1olet merged dpo 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
Models THUDM GLM 4 32B 0414
GLM · MaziyarPanahi
Params32.6B
Context32K
Q4_K_M19.7 GB
MI
Models Miromind Ai MiroThinker v1.0 30B
Mirothinker · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2.5 14B YOYO V2
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
PA
paya
Paya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
VI
VICIOUS MESH 12B BETA
Vicious · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
zephyr beta math Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
VICIOUS MESH 12B OMEGA
Vicious · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
OL
OLMo 2 0325 32B Instruct
OLMo · MaziyarPanahi
Params32.2B
Context4K
Q4_K_M19.5 GB
AL
TQ2.5 14B Aletheia v1
Aletheia · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
SL
MN SlushoMix
Slushomix · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
AR
Arch Function 7B
Arch · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
UI
UIGEN 7B 16bit
Uigen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
Tulpar 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB