GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 4B v0.4 deepresearch no think 4
Qwen · QuantFactory
Params4.41B
Context40K
Q4_K_M2.7 GB
Reasoning
LL
Llama SmolTalk 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HE
HelpingAI 15B
Helpingai · QuantFactory
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
MI
Tor 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LF
LFM2 350M Extract
Lfm · QuantFactory
Params422M
Context125K
Q4_K_M0.3 GB
GGUF
LL
Meta Llama 3.1 8B Claude
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Lumen 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
RoleplayTool use
GU
Guanaco 13B Uncensored
Guanaco · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AT
Athena Codegemma 2 9b
Athena · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
MathCoder2 CodeLlama 7B
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
mistral doryV2 12b
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama DNA 1.0 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VI
Captain Eris Violet V0.420 12B
Violet · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
OpenThinker3 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.1 OpenScholar 8B
Llama · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NX
Nxcode CQ 7B orpo
Nxcode · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
Coding
CH
Chatty Harry V3.0
Chronos · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Llama 3 Hercules 5.0 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Qwen2 7B Instruct deccp
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
MathCoder2 Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
MI
Mistral NeMo Minitron 8B Base
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
DE
deepseek coder 7b instruct v1.5
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MI
mistral nemo cc 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Hebrew Mistral 7B
Mistral · QuantFactory
Params7.5B
Context32K
Q4_K_M4.6 GB
GGUF
LL
L3 Luna 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Coder
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
NE
AceReason Nemotron 1.1 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use

Keep browsing