GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mistral nemo gutenberg 12B v4
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
medius erebus magnum 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
gemma 7b aps it
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Mistral Nemo Japanese Instruct 2408
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
GGUF
QW
UIGEN X 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GE
DiscoPOP zephyr 7b gemma
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
BRAG Llama 3.1 8b v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Llama 3 8B Magpie Pro SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 Ataraxy v2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3 Instruct 8B DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 airoboros3.2 QDT 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
INTELLECT 1
Intellect · QuantFactory
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
DI
DISC MedLLM
Disc · QuantFactory
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
LL
llama 3 zilo sql
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama3.1 s base v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
NightyGurps 14b v1.1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
QW
Math IIO 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
CursorCore QW2.5 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
Coding
LL
calme-2.3-legalkit-8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
StockLLama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RE
web doc refining lm
Redpj · QuantFactory
Params354M
Context2K
Q4_K_M0.2 GB
Coding
LL
llama3.1 gutenberg 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Vikhr-Llama-3.2-1B-instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Open Insurance LLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing