GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Models KISTI KONI KONI Llama3 8B 20240630
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CL
ClimateLlama 8B TR
Climatellama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
PR
L3.1 Promissum Mane 8B Della 1.5 calc
Promissum · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Llama3 8B Aifeifei 1.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-fmruwmd
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
fan o1 7b
Fan · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
Tool use
YA
models--automerger--YamM7-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
RE
ReasonFlux F1 14B
Reasonflux · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
IC
Ice0.101 20.03 RP
Icemedovukharp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Roleplay
CH
MN Chunky Lotus 12B
Chunky · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
NA
NaturalLM 7B Instruct
Naturallm · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-rxkhjnf
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
WA
WavGPT 1.5
Wavgpt · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
GGUF
LL
Llama3.2 3B Enigma
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
QW
Qwen2.5 Coder 14B YOYO
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
CodingTool use
LL
Llama 3.1 8b Dolermed R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
CA
CabraQwen7b
Cabraqwen · MaziyarPanahi
Params7.72B
Context32K
Smallest5.4 GB
GGUF
GE
MT Merge9 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
LL
Llama 3.1 AlternateTokenizer
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
TE
tempestissimo 14b 0309
Tempesthenno · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
GGUF
LL
Llama 3 8B Stroganoff 2.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
VI
Models prithivMLmods Viper Coder v1.1
Viper · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
LL
Defne llama3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
GE
MT Gen8 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
TH
To the end of this earth MN 12B
The · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF

Keep browsing