GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
Noromaid 7b v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
calme-2.1-llama3.1-70b
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--LLaMa-3-Base-Zeroed-13B
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
MI
speechless mistral dolphin orca platypus samantha 7b dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
models--01-ai--Yi-1.5-34B-Chat
Yi · MaziyarPanahi
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
models--mergekit-community--mergekit-passthrough-dmirwnd
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Ognoexperiment27multi verse modelMeliodaspercival 01 experiment26t3q 7B
Meliodaspercival · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--T3qm7xpStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
calme-2.1-phi3.5-4b
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheTop 7B DPO S2 v0.2
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
GreenNode mini 7B v1olet Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-hwgrlbs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
models--mergekit-community--mergekit-slerp-fmitxcg
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-xlkdlta
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--ShadowYamshadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b sft full Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27Experiment29-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Models WeiboAI VibeThinker 1.5B
Vibethinker · MaziyarPanahi
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Openbuddy Qwen2.5Llamaify 14b v23.3 200k
Qwen · MaziyarPanahi
Params14.8B
Context195K
Smallest10.3 GB
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma 2 2b fa v2
Gemma · MaziyarPanahi
Params2.61B
Context8K
Smallest1.9 GB