GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Noromaid 7b v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
calme-2.1-llama3.1-70b
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--LLaMa-3-Base-Zeroed-13B
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
MI
speechless mistral dolphin orca platypus samantha 7b dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
models--01-ai--Yi-1.5-34B-Chat
Yi · MaziyarPanahi
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
models--mergekit-community--mergekit-passthrough-dmirwnd
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
Tool use
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Ognoexperiment27multi verse modelMeliodaspercival 01 experiment26t3q 7B
Meliodaspercival · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--T3qm7xpStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TH
TheTop 7B DPO S2 v0.2
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
GreenNode mini 7B v1olet Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-hwgrlbs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
models--mergekit-community--mergekit-slerp-fmitxcg
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-xlkdlta
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--ShadowYamshadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27Experiment29-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
Models WeiboAI VibeThinker 1.5B
Vibethinker · MaziyarPanahi
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
QW
Openbuddy Qwen2.5Llamaify 14b v23.3 200k
Qwen · MaziyarPanahi
Params14.8B
Context195K
Smallest10.3 GB
GGUF
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
GE
gemma 2 2b fa v2
Gemma · MaziyarPanahi
Params2.61B
Context8K
Smallest1.9 GB
GGUF

Keep browsing