GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Vision
TR
Translategemma 4b It
Translategemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
Vision
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 14B
Qwen · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Vision
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.5 GB
ReasoningTool use
QW
Qwen3 1.7B Abliterated
Qwen · NikolayKozloff
Params1.72B
Context40K
Smallest1.8 GB
ReasoningTool use
MA
madlad400 3b mt Q8 0
Madlad · NikolayKozloff
Params2.94B
Context512
Smallest3.1 GB
GGUF
GE
Gemma 3 1b It
Gemma · NikolayKozloff
Params1B
Context32K
Smallest1.1 GB
GGUF
HY
Hy MT2 7B
NikolayKozloff
Params7.5B
Context256K
Smallest8.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · NikolayKozloff
Params8B
Context128K
Smallest8.5 GB
GGUF
LL
Lexi-Llama-3-8B-Uncensored
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · NikolayKozloff
Params7.5B
Context256K
Smallest8.0 GB
GGUF
LL
llama 13b hf 2048 fpf
Llama · NikolayKozloff
Params13B
Context—
Smallest10.7 GB
GGUF
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Vision
MI
Mistral Nemo Instruct bellman 12b Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
Tool use
KA
Kakugo 3B Tuk
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
KA
kappa 3 phi abliterated Q8 0
Kappa · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
YA
YandexGPT 5 Lite 8B Pretrain
Yandexgpt · NikolayKozloff
Params8.04B
Context32K
Smallest8.5 GB
GGUF
GE
Gemma 3 4b It
Gemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
Vision
HY
HyGPT 10b It
Hygpt · NikolayKozloff
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GP
gpt oss 6.0b specialized all pruned moe only 7 experts Q8 0
gpt-oss · NikolayKozloff
Params5.98B
Context128K
Smallest6.4 GB
Reasoning
LL
Llama 3.1 8B Instruct Reasoner 1o1 v0.3 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
GE
gemma-portuguese-luana-2b
Gemma · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB
GGUF

About NikolayKozloff on Hugging Face

NikolayKozloff has published 1,011 GGUF models that ggufmodels.com tracks, across families such as Llama, Qwen and Mistral. The most downloaded are Translategemma 12b It, Translategemma 12b It and Translategemma 4b It.

The quants NikolayKozloff publishes most often are Q8_0 (523), Q6_K (92), Q5_K_S (73) and Q5_K_M (68). Their Q4_K_M files range from 3.7 to 19.9 GB. Parameter counts run from 30M to 33.1B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has NikolayKozloff published?

1,011 models are listed here, mainly from the Llama, Qwen and Mistral families. The most downloaded is Translategemma 12b It.

Which quants does NikolayKozloff publish?

The most common are Q8_0 (523 models), Q6_K (92 models), Q5_K_S (73 models) and Q5_K_M (68 models).

Keep browsing