GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-64k
Llama · MaziyarPanahi
Params8B
Context63K
Q4_K_M4.9 GB
GGUF
MI
Models Mistralai Mistral Nemo Instruct 2407
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Models Meta Llama Llama 3.3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
models--mistralai--mathstral-7B-v0.1
Mistral · MaziyarPanahi
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
models--Qwen--Qwen2-7B-Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
Models Mistralai Mistral Small Instruct 2409
Mistral · MaziyarPanahi
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 8B Instruct
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Models Mistralai Mistral Small 24B Instruct 2501
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DE
Models Deepseek Ai DeepSeek R1 0528 Qwen3 8B
DeepSeek · MaziyarPanahi
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
GE
Models Google Gemma 3 27b It
Gemma · MaziyarPanahi
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
MI
Models Mistralai Mistral Large Instruct 2411
Mistral · MaziyarPanahi
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Models Qwen QwQ 32B
Qwen · MaziyarPanahi
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek V3 0324
DeepSeek · MaziyarPanahi
Params671B
Context160K
Smallest133.6 GB
GGUF
IN
Models PrimeIntellect INTELLECT 2
Intellect · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.9 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 405B Instruct
Llama · MaziyarPanahi
Params410B
Context128K
Smallest151.2 GB
GGUF
PH
phi 4
Phi · MaziyarPanahi
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
LL
models--fireworks-ai--firefunction-v2
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Models Qwen Qwen3 30B A3B Instruct 2507
Qwen · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Models Qwen Qwen3 Coder Next
Qwen · MaziyarPanahi
Params79.7B
Context256K
Q4_K_M48.4 GB
Coding
GL
Models Zai Org GLM 4.6V Flash
GLM · MaziyarPanahi
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
GP
Models ArliAI Gpt Oss 20b Derestricted
gpt-oss · MaziyarPanahi
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
NE
Models Nvidia Nemotron Orchestrator 8B
Nemotron · MaziyarPanahi
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
TR
Models Arcee Ai Trinity Mini
Trinity · MaziyarPanahi
Params26B
Context128K
Q4_K_M15.8 GB
GGUF
MI
Models Mistralai Ministral 3 14B Reasoning 2512
Mistral · MaziyarPanahi
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
NE
Models Nvidia NVIDIA Nemotron Nano 12B v2
Nemotron · MaziyarPanahi
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
QW
Models Qwen Qwen3 4B Thinking 2507
Qwen · MaziyarPanahi
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
LL
calme 2.4 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Models Qwen Qwen2 Math 72B Instruct
Qwen · MaziyarPanahi
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing