GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.5
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct guidance Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-utpztvu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
calme 3.2 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
TI
MN Tiramisu 12B
Tiramisu · MaziyarPanahi
Params12.2B
Context16K
Smallest8.5 GB
GGUF
TH
TheTop 5x7B Instruct S5 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
HermesStar OrcaWind Synth 11B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TY
typhoon 7b
Typhoon · MaziyarPanahi
Params7.27B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-ties-mojzqgu
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Velara Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CatMacaroni Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--gemma-gemma
Llama · MaziyarPanahi
Params7.24B
Context2K
Q4_K_M4.4 GB
GGUF
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3B Overthinker
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Models Mlx Community Meta Llama 3.1 8B Instruct Bf16
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
HE
Models NousResearch Hermes 4.3 36B
Hermes · MaziyarPanahi
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
NO
models--mergekit-community--Topsecret
Nous · MaziyarPanahi
Params4.62B
Context32K
Q4_K_M2.8 GB
Tool use
SM
Models HuggingFaceTB SmolLM2 1.7B Instruct 16k
SmolLM · MaziyarPanahi
Params1.71B
Context16K
Smallest1.2 GB
GGUF
LL
llama 3 8b English to Hinglish
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
models--mergekit-community--mergekit-ties-jnhzatj
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
shisa base 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Experiment26Strangemerges_30-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MelloGPT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
bagel 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Karen TheEditor V2 STRICT Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing