GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
QW
CyberCore Qwen 2.1 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
LLaMAX3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
14B Qwen2.5 Freya x1
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
SE
SeaLLM 7B v2
Seallm · QuantFactory
Params7.38B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama Guard 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SM
SmolLM2 Prompt Enhance
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
GE
SauerkrautLM Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Gutensuppe mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
NI
L3.1 Niitorm 8B t0.0001
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
WoonaV1.2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
Ph3task2 14B
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
LL
Llama Deepsync 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingTool use
WA
walledguard c
Walledguard · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
OP
OpenCoder 1.5B Base
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
AR
arco reasoner v1.3
Arco · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
QW
Virtuoso Small
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
miscii 14b 1028
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
RoleplayTool use
LL
Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Meraj Mini
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
Vikhr Nemo 12B Instruct R 21 09 24
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3 8B OpenHermes 2.5 1M
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
NI
Astral Fusion Neural Happy L3.1 8B
Nihappy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
TableGPT2 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
suzume llama 3 8B japanese
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 turbcat instruct 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing