GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
G2 9B Sugarquill v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GW
GWQ 9B Preview
Gwq · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
VI
Vistral 7B Chat
Vistral · QuantFactory
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
OD
Odins Allseeing Eye 9B
Odin · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingTool use
CA
Captain BMO 0.420 Magnum 12B
Captain · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
KO
komodo 7b base
Komodo · QuantFactory
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llama 3.2 Korean Bllossom 3B
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3 Open Ko 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
L3 Super Nova RP 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
fusion guide 12b 0.1
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FA
Chili Dog 8B
Fatgirlmagicv · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Halu 8B Llama3 Blackroot
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 mini 4k instruct GGUF v2
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
IN
L3 8B Instruct Abliterated DWP
Instruct · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OU
Oumuamua 7b instruct
Oumuamua · QuantFactory
Params7.33B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Crispy Crab 4B
Instructered · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
llama 3 chinese 8b instruct v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLAMA 3_8B_Unaligned_BETA
Llama · QuantFactory
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
SO
SOLAR 10.7B v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SE
Sekhmet Aleph L3.1 8B v0.1
Sekhmet · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Self Instruct 100K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
Lite Oute 1 300M
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
GE
Veritas 12B
Gemma · QuantFactory
Params12.8B
Context128K
Q4_K_M7.9 GB
Reasoning
LL
LLaMA 3 8B SFR Iterative DPO Concise R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
shisa gamma 7b v1
Shisa · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 Ataraxy v4b 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 Ataraxy v3i 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Trendyol LLM 8b Chat v2.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing