GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 H 1b
Granite · NikolayKozloff
Params1.46B
Context1024K
Smallest1.6 GB
GGUF
CA
CataLlama-v0.1-Instruct-SFT
Catallama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K M
Nemotron · NikolayKozloff
Params14.8B
Context64K
Q4_K_M9.0 GB
CodingReasoningTool use
VI
Viking Magnum v0.1 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 7B Q8 0
Nemotron · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
CodingReasoningTool use
MI
Magiq-3
Mistral · NikolayKozloff
Params18.5B
Context32K
Smallest10.5 GB
GGUF
LI
Light R1 7B DS
Light · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Reasoning
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest6.7 GB
Reasoning
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest11.4 GB
GGUF
GE
gemma-2-9b
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.1 GB
GGUF
QW
Replete LLM V2.5 Qwen 3b
Qwen · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
Tool use
PL
PLLuM 12B nc instruct Q6 K
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
ReasoningTool use
LL
Cogito v1 Preview Llama 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
RO
RoLlama2-7b-Chat
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
GO
Goppa LogiLlama Q8 0
Goppa · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
Tool use
KA
Kakugo 3B Gle
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
BR
fr.brain.carotte 7B Q8 0
Brain · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Q4_K_M9.6 GB
GGUF
RE
Reverb 7b Q6 K
Reverb · NikolayKozloff
Params7.62B
Context32K
Smallest6.3 GB
Tool use
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
GGUF
LL
Llama Estllm Prototype 0825
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
GR
GRMR 2B Instruct old Q8 0
Grmr · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoning
ME
Meltemi 7B v1.5
Meltemi · NikolayKozloff
Params7.48B
Context32K
Smallest8.0 GB
GGUF
SM
SmolLM 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
Tool use
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest10.7 GB
GGUF

Keep browsing