GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Models KISTI KONI KONI Llama3 8B 20240630
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
CL
ClimateLlama 8B TR
Climatellama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
PR
L3.1 Promissum Mane 8B Della 1.5 calc
Promissum · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama3 8B Aifeifei 1.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
models--mergekit-community--mergekit-slerp-fmruwmd
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
fan o1 7b
Fan · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
YA
models--automerger--YamM7-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8b DoberWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
RE
ReasonFlux F1 14B
Reasonflux · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
IC
Ice0.101 20.03 RP
Icemedovukharp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
CH
MN Chunky Lotus 12B
Chunky · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
NA
NaturalLM 7B Instruct
Naturallm · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
LL
models--mergekit-community--mergekit-slerp-rxkhjnf
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
WA
WavGPT 1.5
Wavgpt · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
LL
Llama3.2 3B Enigma
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
QW
Qwen2.5 Coder 14B YOYO
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
Llama 3.1 8b Dolermed R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
CA
CabraQwen7b
Cabraqwen · MaziyarPanahi
Params7.72B
Context32K
Smallest5.4 GB
GE
MT Merge9 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
LL
Llama 3.1 AlternateTokenizer
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
TE
tempestissimo 14b 0309
Tempesthenno · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
Llama 3 8B Stroganoff 2.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
VI
Models prithivMLmods Viper Coder v1.1
Viper · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Defne llama3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GE
MT Gen8 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
TH
To the end of this earth MN 12B
The · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB