GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
models--mergekit-community--JackRussell
Mistral · MaziyarPanahi
Params8.99B
Context32K
Q4_K_M5.4 GB
LL
llama3 8B DarkIdol 1.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
Models OpenPipe Deductive Reasoning Qwen 32B
Qwen · MaziyarPanahi
Params10M
Context32K
Q4_K_M0.0 GB
PH
phi 2
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
RE
ref 70 e3
Ref · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Lexi Uncensored
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
OP
Openchat 3.5 0106
Openchat · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
PH
Models Ykarout Phi4 Reasoning Merged
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
TH
TheTop 5x7B Instruct P v0.1
Thetop · MaziyarPanahi
Params14.2B
Context32K
Q4_K_M8.6 GB
GU
models--AgentPublic--guillaumetell-7b
Guillaumetell · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen3 30B A3B Thinking 2507
Qwen · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Huihui Ai Qwen2.5 7B Instruct Abliterated v3
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3 8B Instruct v0.7
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
L3 Nymeria v2 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
supermario slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
YI
models--mergekit-community--mergekit-passthrough-zpfenfn
Yi · MaziyarPanahi
Params23.2B
Context8K
Q4_K_M14.0 GB
MI
models--mergekit-community--mergekit-slerp-wvyefgo
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8b Dolermed V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
bagel 7b v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openchat 3.5 0106 Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-vhzhpmg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
Llama3.1 8B Chinese Chat
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB