GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
QW
CyberCore Qwen 2.1 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
14B Qwen2.5 Freya x1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
SE
SeaLLM 7B v2
Seallm · QuantFactory
Params7.38B
Context32K
Q4_K_M4.5 GB
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SM
SmolLM2 Prompt Enhance
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GE
SauerkrautLM Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Gutensuppe mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
NI
L3.1 Niitorm 8B t0.0001
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
WoonaV1.2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
PH
Ph3task2 14B
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
LL
Llama Deepsync 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
WA
walledguard c
Walledguard · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
OP
OpenCoder 1.5B Base
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
AR
arco reasoner v1.3
Arco · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
QW
Virtuoso Small
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
miscii 14b 1028
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Meraj Mini
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Vikhr Nemo 12B Instruct R 21 09 24
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 8B OpenHermes 2.5 1M
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NI
Astral Fusion Neural Happy L3.1 8B
Nihappy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
TableGPT2 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
LL
suzume llama 3 8B japanese
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 turbcat instruct 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB