GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
UT
Utopia 13B
Utopia · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TH
L3 TheSpice 8b v0.8.3
Thespice · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OrcaAgent llama3.2 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RO
Rocinante 12B v1.1
Rocinante · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2 Math 1.5B
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
SI
sillyrp 7b
Sillyrp · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Twin 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3SOME 8B v2
Llama · QuantFactory
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
LY
Lyra Gutenbergs Twilight Magnum 12B
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral RP 0.1 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama 3 8B Magpie Air SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
MagicPrompt Stable Diffusion
Magicprompt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MA
magnum v4 22b
Magnum · QuantFactory
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
KA
Kaiju 11B
Kaiju · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
gemma2 9B sunfall v0.5.2
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
MyAlee Qwen Instruct v2 16k v1 merged
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
TH
TheSalt RP L3 8b DPO v0.3.2 e0.14.2
Thesalt · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
KO
L3.1 8B komorebi
Komorebi · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Flammades Mistral Nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SE
Sensei 7B V1
Sensei · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct SLiC HF
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
HelpingAI 9B 200k
Helpingai · QuantFactory
Params8.83B
Context195K
Q4_K_M5.3 GB
GGUF
LL
Fireball Llama 3.1 8B Philos Relection Chat
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HE
HelpingAI 3B chat
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenHathi 7B Hi v0.1 Base
Openhathi · QuantFactory
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
LL
KONI Llama3.1 8B Instruct 20241024
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 Lumimaid 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Hansoldeco Gemma 2 9b it v0.1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing