GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
TR
Trendyol-LLM-7b-chat-v1.8
Trendyol · NikolayKozloff
Params7.34B
Context32K
Smallest5.1 GB
DI
Diver Retriever 4B
Diver · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
GR
granite 20b code instruct Q4 0
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.5 GB
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest7.6 GB
MA
MagpieLM 8B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GR
granite 20b code base Q3 K L
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.6 GB
VI
Viking-33B
Viking · NikolayKozloff
Params33.1B
Context4K
Smallest12.6 GB
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Q4_K_M11.2 GB
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest0.9 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.8 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest8.8 GB
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
PH
Phi 3 mini 4k instruct dansk Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · NikolayKozloff
Params8.04B
Context32K
Smallest8.5 GB
AC
AceMath 7B Instruct
Acemath · NikolayKozloff
Params7.62B
Context4K
Smallest8.1 GB
LL
Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
LL
Llama 3.2 3B
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
CA
CataLlama-v0.1-Instruct-DPO
Catallama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
OR
it-5.4-fp16-orpo-v2
Orpo · NikolayKozloff
Params7.63B
Context32K
Smallest8.1 GB
LL
Selene 1 Mini Llama 3.1 8B Q6 K
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest6.6 GB
GR
Granite 3.2 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest5.5 GB
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Q4_K_M4.7 GB
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.1 GB