GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
mistral nemo gutenberg 12B v4
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
medius erebus magnum 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
gemma 7b aps it
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
QW
UIGEN X 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
DiscoPOP zephyr 7b gemma
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
BRAG Llama 3.1 8b v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3 8B Magpie Pro SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 Ataraxy v2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3 Instruct 8B DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 airoboros3.2 QDT 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
INTELLECT 1
Intellect · QuantFactory
Params10.2B
Context8K
Q4_K_M6.2 GB
DI
DISC MedLLM
Disc · QuantFactory
Params13.3B
Context4K
Q4_K_M8.6 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
LL
llama 3 zilo sql
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3.1 s base v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
NightyGurps 14b v1.1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Math IIO 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
CursorCore QW2.5 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
calme-2.3-legalkit-8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
StockLLama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
web doc refining lm
Redpj · QuantFactory
Params354M
Context2K
Q4_K_M0.2 GB
LL
llama3.1 gutenberg 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SM
SmolLM 135M Instruct
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Open Insurance LLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB