GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
PR
prodigy sm base v0.1 Q8 0
Prodigy · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
BI
BitCPM4 CANN 1B Q8 0
Bitcpm · NikolayKozloff
Params1.62B
Context32K
Smallest1.7 GB
SM
SmolLM2 135M Instruct Q8 0
SmolLM · NikolayKozloff
Params135M
Context8K
Smallest0.1 GB
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest13.4 GB
LL
Llama DNA 1.0 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
QW
leniachat-qwen2-1.5B-v0
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
YU
YuLan Mini
Yulan · NikolayKozloff
Params2.42B
Context28K
Smallest2.6 GB
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest9.2 GB
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest9.0 GB
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
MG
mGPT-1.3B-kirgiz
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
OP
OpenCoder 1.5B Instruct
Opencoder · NikolayKozloff
Params1.91B
Context4K
Smallest2.0 GB
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.9 GB
MA
Marx 3B V2
Marx · NikolayKozloff
Params3.43B
Context—
Smallest2.1 GB
QW
SauerkrautLM-Qwen-32b
Qwen · NikolayKozloff
Params32.5B
Context32K
Smallest14.3 GB
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
ZE
zeta Q8 0
Zeta · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
AR
Arcee-Spark-FP32
Arcee · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
LL
Llama 3.1 Tulu 3 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
KO
kona2 12B Q5 K S
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest8.7 GB
LL
Llama-3-8B-Instruct-Coder
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
BI
BitCPM4 CANN 3B Q8 0
Bitcpm · NikolayKozloff
Params3.61B
Context32K
Smallest3.8 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest11.7 GB
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest8.7 GB