GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
OrpoLlama 3 8B
Orpollama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DI
distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
BI
Bielik 7B Instruct v0.1
Bielik · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
BL
bloom 560m
Bloom · QuantFactory
Params816M
Context1K
Q4_K_M0.6 GB
Coding
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
EU
Eurus 7b kto
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CO
Yi Coder 9B
Coder · QuantFactory
Params8.8B
Context128K
Q4_K_M5.3 GB
Coding
QW
Qwen2 Boundless
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
LL
AMD Llama 135m code
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
Coding
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
BU
Buzz 8b Large v0.5
Buzz · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
MI
mistral nemo wissenschaft 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
GR
granite 8b code instruct 4k
Granite · QuantFactory
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding

Keep browsing