GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Meta Llama 3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
calme-2.2-qwen2-72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
WI
models--microsoft--WizardLM-2-8x22B
Wizardlm · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
MI
models--bullerwins--Codestral-22B-v0.1-hf
Mistral · MaziyarPanahi
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Models Mistralai Mistral Large Instruct 2407
Mistral · MaziyarPanahi
Params123B
Context32K
Q4_K_M73.2 GB
EX
models--automerger--Experiment28Experiment29-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
SU
L3 8B Sunfall v0.5 Stheno v3.2
Sunfall · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
LL
models--mergekit-community--Llama3-12B-wwe
Llama · MaziyarPanahi
Params13.7B
Context8K
Q4_K_M8.3 GB
MI
models--automerger--Experiment28T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
models--automerger--OgnoExperiment27-7B
Ogno · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
Experiment26 7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--Groq--Llama-3-Groq-8B-Tool-Use
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
LU
luxia 21.4b alignment v1.0
Luxia · MaziyarPanahi
Params21.4B
Context32K
Q4_K_M12.9 GB
NE
models--automerger--NeuralsirkrishnaInex12-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--Llama3-13B-ku
Llama · MaziyarPanahi
Params23B
Context8K
Q4_K_M13.9 GB
ME
models--automerger--T3qm7Mergerix-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--Experiment28Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
BioMistral 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Q4_K_M4.7 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
models--automerger--T3qInex12-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--Inex12Multiverseex26-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
calme 2.2 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
MI
models--automerger--CalmexperimentT3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
IN
models--automerger--Inex12Yam-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 16B Instruct v0.1
Llama · MaziyarPanahi
Params16.8B
Context8K
Q4_K_M10.2 GB
ME
models--automerger--MeliodasM7-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB