GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Trendyol-LLM-7b-chat-v1.8
Trendyol · NikolayKozloff
Params7.34B
Context32K
Smallest5.1 GB
GGUF
DI
Diver Retriever 4B
Diver · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
CodingReasoning
GR
granite 20b code instruct Q4 0
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.5 GB
CodingTool use
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest7.6 GB
GGUF
MA
MagpieLM 8B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
GR
granite 20b code base Q3 K L
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.6 GB
Coding
VI
Viking-33B
Viking · NikolayKozloff
Params33.1B
Context4K
Smallest12.6 GB
Coding
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Q4_K_M11.2 GB
Coding
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest0.9 GB
Coding
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.8 GB
ReasoningTool use
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest8.8 GB
GGUF
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
GGUF
PH
Phi 3 mini 4k instruct dansk Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · NikolayKozloff
Params8.04B
Context32K
Smallest8.5 GB
Tool use
AC
AceMath 7B Instruct
Acemath · NikolayKozloff
Params7.62B
Context4K
Smallest8.1 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
Llama 3.2 3B
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
GGUF
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
CA
CataLlama-v0.1-Instruct-DPO
Catallama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoningTool use
OR
it-5.4-fp16-orpo-v2
Orpo · NikolayKozloff
Params7.63B
Context32K
Smallest8.1 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B Q6 K
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest6.6 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
Tool use
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest5.5 GB
Coding
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
CodingReasoning
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.1 GB
GGUF

Keep browsing