GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
falcon mamba 7b instruct Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
GGUF
JA
AI21 Jamba Reasoning 3B
Jamba · NikolayKozloff
Params3.2B
Context256K
Smallest3.4 GB
ReasoningTool use
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Tool use
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Smallest6.7 GB
Vision
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest11.9 GB
GGUF
BI
BitCPM4 CANN 8B Q8 0
Bitcpm · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
GGUF
QW
Qwen3 4B
Qwen · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
Vision
MI
tweety tatar base 7b 2024 v1
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · NikolayKozloff
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
KA
Kakugo 3B Hau
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
ME
Medgemma 4b It
Medgemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
ReasoningVision
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
GGUF
LL
Llama portuguese 13b Luana v0.2
Llama · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
FA
FastApply 1.5B v1.0 Q6 K
Fastapply · NikolayKozloff
Params1.54B
Context32K
Smallest1.3 GB
GGUF
MA
MagpieLM 4B Chat v0.1 Q8 0
Magpielm · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
GGUF
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.5 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
Llammas base Estonian
Llammas · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
QW
Qwen3 0.6B Instruct Uz
Qwen · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
GE
gemma-2-27b
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest12.2 GB
GGUF
KA
Kakugo 3B Bak
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
GR
Granite 4.1 8b
Granite · NikolayKozloff
Params8.79B
Context128K
Smallest9.3 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
Tool use
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.5 GB
GGUF
SE
SERA 8B GA
Sera · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use

Keep browsing