GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
neural chat 7b v3 1
Mistral · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
YU
YuLan Mini
Yulan · QuantFactory
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
ME
II Medical 8B 1706
Medical · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
HA
Hathor L3 8B v.02
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Mistrilitary 7b
Army · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma2 9b cpt sahabatai v1 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3 RedMagic4 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B ProLong 512k Base
Llama · QuantFactory
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
PA
StarDust 12b v2
Pantheon · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
Llama Deepsync 1B
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingTool use
PA
palmyra mini thinking a
Palmyra · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoning
LL
Llama 3.1 8B Lexi Uncensored
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
dolphin 2.6 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · QuantFactory
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
DE
deepseek v3 tiny random
DeepSeek · QuantFactory
Params9M
Context—
Q4_K_M0.0 GB
GGUF
LL
Theia Llama 3.1 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 EZO 8b Common it
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLama 3.1 Hyper Stock
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
Fatgirl v2 8B
Magic · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
LL
L3.1 Purosani 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
Control 8B V1.1
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama3 OpenBioLLM 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LE
Chewy Lemon Cookie 11B
Lemonaderp · QuantFactory
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
LL
ArliAI Llama 3 8B Instruct DPO v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Tulu MathLingo 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing