Tema GGUF models

75 GGUF models in the Tema family, quantized by 6 uploaders. Sizes run from 354M to 79.7B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TE
Tema_Q R2.0 Code
Tema · mradermacher
Params8.5B
Context8K
Q4_K_M5.3 GB
Coding
TE
Tema_Q X3
Tema · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Tool use
TE
Tema_Q X5 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
TE
Tema_Q X2 Thinking
Tema · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
TE
Tema_Q X4 Thinking
Tema · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
TE
Tema_Q X6 9B Thinking
Tema · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
TE
Tema_Q R7.0
Tema · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TE
Tema_Q X
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q X5 12B Thinking
Tema · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
TE
Tema_Q X2 Thinking
Tema · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TE
Tema_Q X3 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
TE
Tema_Q R 3B Thinking
Tema · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
TE
Tema_Q R4.2
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q R2.0 Code
Tema · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Coding
TE
Tema_Q X6 9B Thinking
Tema · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
TE
Tema_Q X5 12B Thinking
Tema · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
TE
Tema_Q X4 8B Thinking
Tema · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
TE
Tema_Q X4 Thinking
Tema · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
TE
Tema_Q X8 Thinking
Tema · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
TE
Tema_Q R7.0
Tema · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
TE
Tema_Q R 4B
Tema · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TE
Tema_Q X7 Thinking
Tema · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Reasoning
TE
Tema_Q X5 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
TE
Tema_Q X4 8B
Tema · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
Tool use
TE
Tema_Q X3 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
TE
Tema_Q X3
Tema · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Tool use
TE
Tema_Q R4.2
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q R12.2
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q X4
Tema · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
Tool use
TE
Tema_Q X7 Thinking
Tema · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision

About the Tema GGUF models

Tema is represented on ggufmodels.com by 75 GGUF models, quantized by 6 uploaders on Hugging Face. The most downloaded are Tema_Q R2.0 Code, Tema_Q X3 and Tema_Q X5 Thinking. Parameter counts run from 354M to 79.7B, and the longest trained context window is 256K tokens.

A Q4_K_M file of a Tema model is between 0.2 to 48.5 GB, which is the quant most people start with. Most files come from mradermacher (54), TaQuants (7) and yuna1126 (6). The quants you will meet most often are Q4_K_M (65), Q2_K (59), Q3_K_M (58) and Q6_K (57), where the number is how many models offer that quant.

Frequently asked questions

Which Tema GGUF should I download?

The most downloaded Tema GGUF here is Tema_Q R2.0 Code. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Tema model need?

Q4_K_M files of Tema models on this site range from 0.2 to 48.5 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Tema GGUF files come from?

The most common quantizers here are mradermacher, TaQuants and yuna1126. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing