GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
BR
Breeze 7B Instruct v1 0
Breeze · QuantFactory
Params7.49B
Context32K
Q4_K_M4.5 GB
LL
HuatuoGPT o1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GE
Darkest muse v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3 8B ShareGPT 112K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
MilkDropLM 7b v0.3
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
magnum v2 12b
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
gpt5o reflexion q agi llama 3.1 8b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
MoE Girl 400MA 1BT
Granite · QuantFactory
Params1.33B
Context8K
Q4_K_M0.8 GB
MA
marco o1 uncensored
Marco · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
PA
palmyra mini thinking b
Palmyra · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
EA
eai distill 0.5b
Eai · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
LL
Llama 3 Alpha Centauri v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
MN RocinanteCelestar 12B
Rocinante · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Eximius_Persona_5B
Llama · QuantFactory
Params5.82B
Context128K
Q4_K_M3.6 GB
GE
buddhi indic
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
mistral rrc
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Einstein v7 Qwen2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ME
medicine chat
Medicine · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
NO
Noromaid 13b v0.2
Noromaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
FA
FastApply 7B v1.0
Fastapply · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
openthaigpt1.5 7b instruct
Openthaigpt · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
ArliAI Llama 3 8B Dolfin v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MalayaLLM Gemma 2 9B Instruct V1.0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
VA
ValueLlama 3 8B
Valuellama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fireball Llama 3.1 8B Philos Math v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SU
MN 12B Mag Mell R1
Sunrose · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Q2.5 Veltha 14B 0.5
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
EX
EXAONE Deep 2.4B
Exaone · QuantFactory
Params2.67B
Context32K
Q4_K_M1.6 GB