GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Llama Guard 3 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
PH
Athene Phi 3.5 mini instruct orpo i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
NE
NeoHorse 1 9B Math SFT
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
Coding
AR
AREX 2 i1
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
ZE
Zephyr 7B Beta Harmless
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
LL
LogDoctor Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
SA
SauerkrautLM 7b LaserChat
Sauerkrautlm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CY
Cydonia 24B v4.3 Heretic v4
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
ChemLLM 20B Chat SFT i1
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
TU
Tulu 2 7B Helpful
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
QW
Bella Bartender Qwen3.5 2b
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
Reasoning
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 VL 32B Instruct Heretic
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
CodingVision
RE
Reggie v2 7b
Reggie · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningVision
SE
sexeh time testing
Sexeh · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
0G
0GM 1.0 35B A3B 0427
mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GA
GameScaling 27B S3
Gamescaling · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
DA
Davinci Tool 30B
Davinci · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use

Keep browsing