GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
G2 9B Sugarquill v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GW
GWQ 9B Preview
Gwq · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
VI
Vistral 7B Chat
Vistral · QuantFactory
Params7.29B
Context32K
Q4_K_M4.4 GB
OD
Odins Allseeing Eye 9B
Odin · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
CA
Captain BMO 0.420 Magnum 12B
Captain · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
KO
komodo 7b base
Komodo · QuantFactory
Params6.76B
Context4K
Q4_K_M4.1 GB
LL
llama 3.2 Korean Bllossom 3B
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3 Open Ko 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
L3 Super Nova RP 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
fusion guide 12b 0.1
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
FA
Chili Dog 8B
Fatgirlmagicv · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
LL
Halu 8B Llama3 Blackroot
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 mini 4k instruct GGUF v2
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
IN
L3 8B Instruct Abliterated DWP
Instruct · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OU
Oumuamua 7b instruct
Oumuamua · QuantFactory
Params7.33B
Context32K
Q4_K_M4.4 GB
IN
Crispy Crab 4B
Instructered · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
llama 3 chinese 8b instruct v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLAMA 3_8B_Unaligned_BETA
Llama · QuantFactory
Params8.03B
Context16K
Q4_K_M4.9 GB
SO
SOLAR 10.7B v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
SE
Sekhmet Aleph L3.1 8B v0.1
Sekhmet · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Self Instruct 100K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
Lite Oute 1 300M
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
GE
Veritas 12B
Gemma · QuantFactory
Params12.8B
Context128K
Q4_K_M7.9 GB
LL
LLaMA 3 8B SFR Iterative DPO Concise R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SH
shisa gamma 7b v1
Shisa · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy v4b 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 Ataraxy v3i 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Trendyol LLM 8b Chat v2.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB