GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
OR
OrpoLlama 3 8B
Orpollama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
DI
distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
BI
Bielik 7B Instruct v0.1
Bielik · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
BL
bloom 560m
Bloom · QuantFactory
Params816M
Context1K
Q4_K_M0.6 GB
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
EU
Eurus 7b kto
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
CO
Yi Coder 9B
Coder · QuantFactory
Params8.8B
Context128K
Q4_K_M5.3 GB
QW
Qwen2 Boundless
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
LL
AMD Llama 135m code
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
BU
Buzz 8b Large v0.5
Buzz · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
MI
mistral nemo wissenschaft 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.6B
Context128K
Q4_K_M4.7 GB
GR
granite 8b code instruct 4k
Granite · QuantFactory
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB