GGUF models by Theros

103 GGUF models quantized by Theros on Hugging Face. Sizes run from 40M to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Q2.5 DeepSeek R1 DeepThink test1 Q4 K M
DeepSeek · Theros
Params9.25B
Context128K
Q4_K_M5.7 GB
ReasoningTool use
LL
Llama3.2 ColdBrew 3B OverThinker
Llama · Theros
Params3.21B
Context128K
Smallest2.6 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Fusion Test1
Coldbrew · Theros
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
CO
Q2.5 ColdBrew R1 Obsidian Q4 K M
Coldbrew · Theros
Params9.24B
Context128K
Q4_K_M5.7 GB
Reasoning
CH
L3 CharThink Base Test1
Charthink · Theros
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
CO
Q2.5 ColdBrew R1 Forge
Coldbrew · Theros
Params9.48B
Context128K
Q4_K_M5.8 GB
Reasoning
CO
ColdBrew Nemo 12B Arcane Fusion RPThink0
Coldbrew · Theros
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
Q2.5 ColdBrew Antrax Forge 10B TestSFT1
Coldbrew · Theros
Params9.94B
Context128K
Q4_K_M6.1 GB
GGUF
LL
Llama3.2 ColdBrew 4x3B Argon Test1
Llama · Theros
Params9.55B
Context128K
Smallest6.8 GB
GGUF
PH
Phi 4 ColdBrew 14B Test2
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
CO
Q2.5 ColdBrew Rx
Coldbrew · Theros
Params9.24B
Context128K
Q4_K_M5.7 GB
GGUF
QW
Qwen2.5 ColdBrew
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
Qwen2.5 ColdBrew Erratik Q5 K M
Qwen · Theros
Params7.61B
Context128K
Smallest5.4 GB
GGUF
QW
Qwen2.5 ColdBrew Aetheria Test2_Tools
Qwen · Theros
Params7.61B
Context128K
Smallest5.4 GB
Tool use
QW
Qwen2.5 ColdBrew 7B GRPO
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
SP
MN CharThink temp F16
Spicyomelettes · Theros
Params52M
Context—
Smallest0.1 GB
GGUF
SP
L3 SpicyOmelettes 10B Base1
Spicyomelettes · Theros
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF
QW
Qwen2.5 ColdBrew R1 Q4 K M
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
Qwen2.5 ColdBrew R1 Test
Qwen · Theros
Params7.61B
Context128K
Smallest5.4 GB
Reasoning
CO
ColdBrew Nemo 12B Arcane Fusion CharTest0
Coldbrew · Theros
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Base Test0
Coldbrew · Theros
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 ColdBrew Solipsis Q5 K M
Qwen · Theros
Params7.61B
Context128K
Smallest5.4 GB
GGUF
PH
Phi 4 ColdBrew 14B Test0
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Fusion Test2
Coldbrew · Theros
Params12.2B
Context128K
Smallest8.7 GB
GGUF
QW
Qwen2.5 ColdBrew Antrax
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 ColdBrew R1 test8 Q4 K M
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
CO
ColdBrew Nemo 12B Arcane Fusion Combined Thinker Test0
Coldbrew · Theros
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
SO
SOR ColdBrew 12B Base Testing
Sor · Theros
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 ColdBrew UNO test Q4 K M
Qwen · Theros
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
CO
Q2.5 ColdBrew 14B Base RP
Coldbrew · Theros
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay

Keep browsing