GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
QW
Rombos LLM V2.5.1 Qwen 3b
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
miniclaus qw1.5B UNAMGS
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
SuperNova Medius
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GP
gpt2 large
Gpt · QuantFactory
Params838M
Context1K
Q4_K_M0.5 GB
SA
Sakura 13B Galgame
Sakura · QuantFactory
Params13.9B
Context4K
Q4_K_M9.0 GB
GR
granite 3.1 2b base
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
SM
SmolLM 360M Instruct
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
MI
Mistral 7B v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
ChimeraLlama 3 8B v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MP
mpt 7b storywriter
Mpt · QuantFactory
Params6.65B
Context64K
Q4_K_M4.3 GB
ME
II Medical 8B
Medical · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
IN
internlm2 5 1 8b chat
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
MA
magnum v2.5 12b kto
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
NY
Nymph 8B
Nymph · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Magpie Pro MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Matter 0.2 7B
Matter · QuantFactory
Params7B
Context32K
Q4_K_M4.4 GB
GE
G2 9B Aletheia v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
MiniCPM4.1 8B
MiniCPM · QuantFactory
Params8.19B
Context64K
Q4_K_M5.0 GB
LL
ArliAI Llama 3 8B Dolfin v0.2 Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMA Mesh
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3 youko 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
granite 3.0 8b instruct
Granite · QuantFactory
Params8.17B
Context4K
Q4_K_M4.9 GB
MA
MagpieLM 8B Chat v0.1
Magpielm · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ChimeraLlama 3 8B v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 3 clinical
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
L3 Deluxe Scrambled Eggs On Toast 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
AE
L3 Aethora 15B V2
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
ST
stablelm zephyr 3b
Stablelm · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GR
granite 3.1 1b a400m base
Granite · QuantFactory
Params1.38B
Context128K
Q4_K_M0.9 GB