GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Rombos LLM V2.5.1 Qwen 3b
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
miniclaus qw1.5B UNAMGS
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
QW
SuperNova Medius
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
GP
gpt2 large
Gpt · QuantFactory
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
SA
Sakura 13B Galgame
Sakura · QuantFactory
Params13.9B
Context4K
Q4_K_M9.0 GB
GGUF
GR
granite 3.1 2b base
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
MI
Mistral 7B v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ChimeraLlama 3 8B v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MP
mpt 7b storywriter
Mpt · QuantFactory
Params6.65B
Context64K
Q4_K_M4.3 GB
GGUF
ME
II Medical 8B
Medical · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
IN
internlm2 5 1 8b chat
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
MA
magnum v2.5 12b kto
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NY
Nymph 8B
Nymph · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 8B Magpie Pro MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
Matter 0.2 7B
Matter · QuantFactory
Params7B
Context32K
Q4_K_M4.4 GB
GGUF
GE
G2 9B Aletheia v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
MiniCPM4.1 8B
MiniCPM · QuantFactory
Params8.19B
Context64K
Q4_K_M5.0 GB
Reasoning
LL
ArliAI Llama 3 8B Dolfin v0.2 Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA Mesh
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 3 youko 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
granite 3.0 8b instruct
Granite · QuantFactory
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
MA
MagpieLM 8B Chat v0.1
Magpielm · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ChimeraLlama 3 8B v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 3 clinical
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
L3 Deluxe Scrambled Eggs On Toast 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
AE
L3 Aethora 15B V2
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
ST
stablelm zephyr 3b
Stablelm · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
GR
granite 3.1 1b a400m base
Granite · QuantFactory
Params1.38B
Context128K
Q4_K_M0.9 GB
GGUF

Keep browsing