GGUF models by Kondara

52 GGUF models quantized by Kondara on Hugging Face. Sizes run from 1.23B to 19.9B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 7B Instruct
Qwen · Kondara
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Kondara
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
LL
Llama 3.2 3B Instruct
Llama · Kondara
Params3.21B
Context128K
Smallest2.6 GB
Tool use
GE
Gemma 3 12b It
Gemma · Kondara
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
LL
Llama 3.2 3B Instruct
Llama · Kondara
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · Kondara
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SA
Sailor 7B Chat
Sailor · Kondara
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
LL
cendol-llama2-7b-chat
Llama · Kondara
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SE
SeaLLMs v3 1.5B Chat
Seallms · Kondara
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
LL
cendol llama2 7b inst Q4 K M
Llama · Kondara
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 14B
Qwen · Kondara
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 8B
Qwen · Kondara
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
Mistral Nemo Instruct 2407
Mistral · Kondara
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Kondara
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
FA
Falcon 7b Instruct
Falcon · Kondara
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · Kondara
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FA
Falcon 11B
Falcon · Kondara
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · Kondara
Params7.62B
Context32K
Smallest8.1 GB
Tool use
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · Kondara
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
cendol-llama2-13b-merged-inst
Llama · Kondara
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · Kondara
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
YI
Yi 1.5 9B Chat
Yi · Kondara
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · Kondara
Params14B
Context128K
Q4_K_M8.6 GB
Coding
LL
Llama 3.2 1B Instruct
Llama · Kondara
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · Kondara
Params3.21B
Context128K
Smallest3.4 GB
Tool use
GE
Gemma 2 2b It
Gemma · Kondara
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · Kondara
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · Kondara
Params2.61B
Context8K
Smallest2.8 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · Kondara
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BA
Bahasa 4b Q4 K M
Bahasa · Kondara
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF

About Kondara on Hugging Face

Kondara has published 52 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Qwen. The most downloaded are Qwen2.5 Coder 7B Instruct, DeepSeek R1 Distill Qwen 7B and Llama 3.2 3B Instruct.

The quants Kondara publishes most often are Q4_K_M (45), Q8_0 (5) and Q6_K (2). Their Q4_K_M files range from 0.8 to 12.0 GB. Parameter counts run from 1.23B to 19.9B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has Kondara published?

52 models are listed here, mainly from the Llama, Gemma and Qwen families. The most downloaded is Qwen2.5 Coder 7B Instruct.

Which quants does Kondara publish?

The most common are Q4_K_M (45 models), Q8_0 (5 models) and Q6_K (2 models).

Keep browsing