GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BR
Breeze 7B Instruct v1 0
Breeze · QuantFactory
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
LL
HuatuoGPT o1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
GE
Darkest muse v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3 8B ShareGPT 112K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
MilkDropLM 7b v0.3
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
magnum v2 12b
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
gpt5o reflexion q agi llama 3.1 8b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
MoE Girl 400MA 1BT
Granite · QuantFactory
Params1.33B
Context8K
Q4_K_M0.8 GB
Roleplay
MA
marco o1 uncensored
Marco · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PA
palmyra mini thinking b
Palmyra · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoning
EA
eai distill 0.5b
Eai · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
LL
Llama 3 Alpha Centauri v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
MN RocinanteCelestar 12B
Rocinante · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Eximius_Persona_5B
Llama · QuantFactory
Params5.82B
Context128K
Q4_K_M3.6 GB
GGUF
GE
buddhi indic
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
mistral rrc
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Einstein v7 Qwen2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
ME
medicine chat
Medicine · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Noromaid 13b v0.2
Noromaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
FastApply 7B v1.0
Fastapply · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OP
openthaigpt1.5 7b instruct
Openthaigpt · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
ArliAI Llama 3 8B Dolfin v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MalayaLLM Gemma 2 9B Instruct V1.0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
VA
ValueLlama 3 8B
Valuellama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Fireball Llama 3.1 8B Philos Math v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SU
MN 12B Mag Mell R1
Sunrose · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
QW
Q2.5 Veltha 14B 0.5
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
EX
EXAONE Deep 2.4B
Exaone · QuantFactory
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF

Keep browsing