GGUF models by TeichAI
60 GGUF models quantized by TeichAI on Hugging Face. Sizes run from 20M to 32.8B parameters. The longest trained context is 256K tokens.
DE
Nemotron Orchestrator 8B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 4B Thinking 2507 GPT 5.1 Codex Max Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
Qwen3 4B Thinking 2507 DeepSeek v3.2 Speciale Math Distill
DeepSeek · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Instruct 2507 Gemini 3 Pro Preview Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 30B A3B Thinking 2507 Claude 4.5 Sonnet High Reasoning Distill
Qwen · TeichAI
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 4B Claude Opus Reasoning
Qwen · TeichAI
Params4.21B
Context256K
Q4_K_M2.7 GB
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · TeichAI
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3.6 27B Claude Opus Reasoning Distill
Qwen · TeichAI
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 4B GPT 5.2 High Reasoning Distill
Qwen · TeichAI
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 4B Thinking 2507 Claude 4.5 Opus High Reasoning Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 32B Kimi K2 Thinking Distill
Qwen · TeichAI
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · TeichAI
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3 30B A3B Thinking 2507 Gemini 2.5 Flash Distill
Qwen · TeichAI
Params30.5B
Context256K
Q4_K_M18.6 GB
GL
Gpt Oss 20b Glm 4.6 Distill
GLM · TeichAI
Params20.9B
Context128K
Smallest12.1 GB
QW
Qwen3 8B Claude 4.5 Opus High Reasoning Distill
Qwen · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
GP
Gpt Oss 20b Gpt 5 Codex Distill
gpt-oss · TeichAI
Params20.9B
Context128K
Smallest12.1 GB
QW
Qwen3 4B Instruct grok 4 fast brainstorming distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 1.7B Gemini 2.5 Flash Lite Preview Distill
Qwen · TeichAI
Params1.72B
Context40K
Smallest1.8 GB
GP
Gpt Oss 20b Claude 4.5 Sonnet High Reasoning Distill
gpt-oss · TeichAI
Params20.9B
Context128K
Smallest13.8 GB
QW
Qwen3 4B Instruct 2507 Claude Opus 3 Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill
Qwen · TeichAI
Params4.02B
Context256K
Smallest4.3 GB
QW
Qwen3 4B Thinking 2507 Gemini 3 Flash VIBE F16
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Thinking 2507 Gemini 3 Pro Preview High Reasoning Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Thinking 2507 GPT 5 Codex Distill
Qwen · TeichAI
Params4.02B
Context256K
Smallest4.3 GB
QW
Qwen3 4B Instruct 2507 Polaris Alpha Distill
Qwen · TeichAI
Params4.02B
Context256K
Smallest4.3 GB
QW
Qwen3 4B Thinking 2507 Kimi K2 Thinking Distill
Qwen · TeichAI
Params4.02B
Context256K
Smallest4.3 GB
LF
LFM2.5 1.2B Thinking Pony Alpha Distill
Lfm · TeichAI
Params1.17B
Context125K
Smallest0.7 GB
QW
Qwen3 4B Thinking 2507 GLM 4.6 Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
Mistral 7B v0.3 Mistral Small Creative Distill
Mistral · TeichAI
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Minimax M2.7 Opus 4.6 Distill Lora
Minimax · TeichAI
Params20M
Context—
Smallest0.0 GB