GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
prodigy sm base v0.1 Q8 0
Prodigy · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
BI
BitCPM4 CANN 1B Q8 0
Bitcpm · NikolayKozloff
Params1.62B
Context32K
Smallest1.7 GB
GGUF
SM
SmolLM2 135M Instruct Q8 0
SmolLM · NikolayKozloff
Params135M
Context8K
Smallest0.1 GB
GGUF
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest13.4 GB
Coding
LL
Llama DNA 1.0 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
QW
leniachat-qwen2-1.5B-v0
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
GGUF
YU
YuLan Mini
Yulan · NikolayKozloff
Params2.42B
Context28K
Smallest2.6 GB
Coding
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest9.2 GB
GGUF
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest9.0 GB
GGUF
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
GGUF
MG
mGPT-1.3B-kirgiz
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
OP
OpenCoder 1.5B Instruct
Opencoder · NikolayKozloff
Params1.91B
Context4K
Smallest2.0 GB
Coding
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.9 GB
GGUF
MA
Marx 3B V2
Marx · NikolayKozloff
Params3.43B
Context—
Smallest2.1 GB
GGUF
QW
SauerkrautLM-Qwen-32b
Qwen · NikolayKozloff
Params32.5B
Context32K
Smallest14.3 GB
GGUF
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
ZE
zeta Q8 0
Zeta · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GGUF
AR
Arcee-Spark-FP32
Arcee · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
KO
kona2 12B Q5 K S
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest8.7 GB
GGUF
LL
Llama-3-8B-Instruct-Coder
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
Coding
BI
BitCPM4 CANN 3B Q8 0
Bitcpm · NikolayKozloff
Params3.61B
Context32K
Smallest3.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest11.7 GB
GGUF
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest8.7 GB
Reasoning

Keep browsing