GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
gemma 3 270m it
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LU
NarraThinker12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
BL
bloomz 560m
Bloomz · QuantFactory
Params816M
Context2K
Q4_K_M0.6 GB
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Neumind Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
Typst Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
QW
Replete LLM Qwen2 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
NuExtract 1.5 tiny
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
MI
Mistral 7B Instruct Uz
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
PR
FW ProX 1.7B
Prox · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
TI
TinyAgent 7B
Tinyagent · QuantFactory
Params8.03B
Context10K
Q4_K_M4.9 GB
LL
Llama3.1 BestMix Chem Einstein 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
OpenCoder 8B Base
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · QuantFactory
Params7.82B
Context32K
Q4_K_M4.8 GB
LL
Llama3.1 8B Enigma
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LY
Lyra4 Gutenberg 12B
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 Reranker 0.6B
Qwen · QuantFactory
Params751M
Context40K
Q4_K_M0.5 GB
QW
Hercules 5.0 Qwen2 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GE
ko gemma 2 9b it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3 8b Ita
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
HelpingAI2 9B
Helpingai · QuantFactory
Params8.9B
Context128K
Q4_K_M5.4 GB
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Atlas Chat 2B
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
CodeLlama 7b hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
pair preference model LLaMA3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
BU
Buddy 2B v1
Buddy · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
AI Sweden Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
SmallThinker 3B Preview
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB