GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 3 270m it
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LU
NarraThinker12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BL
bloomz 560m
Bloomz · QuantFactory
Params816M
Context2K
Q4_K_M0.6 GB
Coding
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Neumind Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CO
Typst Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
QW
Replete LLM Qwen2 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
NuExtract 1.5 tiny
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
MI
Mistral 7B Instruct Uz
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
PR
FW ProX 1.7B
Prox · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
TI
TinyAgent 7B
Tinyagent · QuantFactory
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 BestMix Chem Einstein 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OP
OpenCoder 8B Base
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
EX
EXAONE 3.5 7.8B Instruct
Exaone · QuantFactory
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
LL
Llama3.1 8B Enigma
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LY
Lyra4 Gutenberg 12B
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Qwen3 Reranker 0.6B
Qwen · QuantFactory
Params751M
Context40K
Q4_K_M0.5 GB
EmbeddingReasoningTool use
QW
Hercules 5.0 Qwen2 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
GE
ko gemma 2 9b it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3 8b Ita
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
HelpingAI2 9B
Helpingai · QuantFactory
Params8.9B
Context128K
Q4_K_M5.4 GB
Tool use
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Atlas Chat 2B
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
CodeLlama 7b hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
pair preference model LLaMA3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BU
Buddy 2B v1
Buddy · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AI Sweden Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
SmallThinker 3B Preview
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
Reasoning

Keep browsing