GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
neural chat 7b v3 1
Mistral · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
YU
YuLan Mini
Yulan · QuantFactory
Params2.42B
Context28K
Q4_K_M1.8 GB
ME
II Medical 8B 1706
Medical · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
HA
Hathor L3 8B v.02
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
Mistrilitary 7b
Army · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma2 9b cpt sahabatai v1 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3 RedMagic4 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B ProLong 512k Base
Llama · QuantFactory
Params8.03B
Context512K
Q4_K_M4.9 GB
CE
L3.1 8B Celeste V1.5
Celeste · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
PA
StarDust 12b v2
Pantheon · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama Deepsync 1B
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
PA
palmyra mini thinking a
Palmyra · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
dolphin 2.6 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemotron Mini 4B Instruct
Nemotron · QuantFactory
Params4.19B
Context4K
Q4_K_M2.7 GB
DE
deepseek v3 tiny random
DeepSeek · QuantFactory
Params9M
Context—
Q4_K_M0.0 GB
LL
Theia Llama 3.1 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Taiwan 8B Instruct DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 EZO 8b Common it
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLama 3.1 Hyper Stock
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Fatgirl v2 8B
Magic · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
LL
L3.1 Purosani 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
Control 8B V1.1
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 OpenBioLLM 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LE
Chewy Lemon Cookie 11B
Lemonaderp · QuantFactory
Params10.7B
Context8K
Q4_K_M6.5 GB
LL
ArliAI Llama 3 8B Instruct DPO v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Tulu MathLingo 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB