GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
models--mergekit-community--JackRussell
Mistral · MaziyarPanahi
Params8.99B
Context32K
Q4_K_M5.4 GB
Tool use
LL
llama3 8B DarkIdol 1.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
Models OpenPipe Deductive Reasoning Qwen 32B
Qwen · MaziyarPanahi
Params10M
Context32K
Q4_K_M0.0 GB
ReasoningTool use
PH
phi 2
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
RE
ref 70 e3
Ref · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Lexi Uncensored
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
OP
Openchat 3.5 0106
Openchat · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
PH
Models Ykarout Phi4 Reasoning Merged
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
Reasoning
TH
TheTop 5x7B Instruct P v0.1
Thetop · MaziyarPanahi
Params14.2B
Context32K
Q4_K_M8.6 GB
GGUF
GU
models--AgentPublic--guillaumetell-7b
Guillaumetell · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Qwen Qwen3 30B A3B Thinking 2507
Qwen · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Huihui Ai Qwen2.5 7B Instruct Abliterated v3
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
LL
Llama 3 8B Instruct v0.7
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
L3 Nymeria v2 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
supermario slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
YI
models--mergekit-community--mergekit-passthrough-zpfenfn
Yi · MaziyarPanahi
Params23.2B
Context8K
Q4_K_M14.0 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-wvyefgo
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8b Dolermed V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MI
bagel 7b v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
openchat 3.5 0106 Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-vhzhpmg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing