GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Perky Pat Instruct 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Swallow 8B Instruct v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.0 Uncensored
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Luna AI Llama2 Uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MO
Moistral 11B v3
Moistral · QuantFactory
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 8B Instruct MopeyMule
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 Ataraxy v4d 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OL
AMD OLMo 1B
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
LL
vietnamese llama2 7b 120GB
Llama · QuantFactory
Params6.85B
Context2K
Q4_K_M4.2 GB
GGUF
LL
Llama3 DiscoLeo Instruct 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
Replete Coder Instruct 8b Merged
Replete · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LI
Lite Oute 1 300M Instruct
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
CO
Control 8B
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
PO
Poppy Porpoise 0.85 L3 8B
Poppy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
IceMartiniRP 7b
Icemartinirp · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
h2o danube3 4b chat
Danube · QuantFactory
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
LL
HALU 8B LLAMA3 BRSLURP
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
NemoReRemix 12B
Nemoreremix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepCoder 1.5B Preview
Deepcoder · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingTool use
LL
Meta Llama 3 225B Instruct
Llama · QuantFactory
Params225B
Context8K
Q4_K_M134.8 GB
GGUF
DE
DeepCoder 14B Preview
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
BU
bueble lm 2b
Bueble · QuantFactory
Params2.07B
Context8K
Q4_K_M1.3 GB
GGUF
RH
rho math 7b v0.1
Rho · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chat2DB SQL 7B
Chat · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
FA
FastApply 1.5B v1.0
Fastapply · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
PH
Borea Phi 3.5 mini Instruct Jp
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
LLaMA O1 Supervised 1129
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FU
functionary small v2.2
Functionary · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
Gemma 2 9B Chinese Chat
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing