GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.5
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct guidance Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-utpztvu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
calme 3.2 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
TI
MN Tiramisu 12B
Tiramisu · MaziyarPanahi
Params12.2B
Context16K
Smallest8.5 GB
TH
TheTop 5x7B Instruct S5 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
HermesStar OrcaWind Synth 11B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TY
typhoon 7b
Typhoon · MaziyarPanahi
Params7.27B
Context32K
Q4_K_M4.4 GB
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-ties-mojzqgu
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Velara Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CatMacaroni Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--gemma-gemma
Llama · MaziyarPanahi
Params7.24B
Context2K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 3B Overthinker
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Models Mlx Community Meta Llama 3.1 8B Instruct Bf16
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
HE
Models NousResearch Hermes 4.3 36B
Hermes · MaziyarPanahi
Params36.2B
Context512K
Q4_K_M21.8 GB
NO
models--mergekit-community--Topsecret
Nous · MaziyarPanahi
Params4.62B
Context32K
Q4_K_M2.8 GB
SM
Models HuggingFaceTB SmolLM2 1.7B Instruct 16k
SmolLM · MaziyarPanahi
Params1.71B
Context16K
Smallest1.2 GB
LL
llama 3 8b English to Hinglish
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
LL
models--mergekit-community--mergekit-ties-jnhzatj
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shisa base 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Experiment26Strangemerges_30-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MelloGPT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
bagel 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Karen TheEditor V2 STRICT Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB