GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest10.5 GB
ReasoningTool use
HU
Hunyuan 0.5B Instruct
Hunyuan · NikolayKozloff
Params539M
Context256K
Smallest0.6 GB
ReasoningTool use
NA
Nanbeige4.1 3B
Nanbeige · NikolayKozloff
Params3.93B
Context256K
Smallest4.2 GB
ReasoningTool use
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest7.8 GB
Reasoning
KA
Kakugo 3B Ydd
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
KA
Kakugo 3B Kir
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
EV
EVA GPT German Q6 K
Eva · NikolayKozloff
Params7.24B
Context32K
Smallest5.9 GB
GGUF
VI
Vikhr Nemo 12B Instruct R 21 09 24 Q8 0
Vikhr · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
QW
Qwen3 16B A3B
Qwen · NikolayKozloff
Params16B
Context40K
Q4_K_M9.8 GB
ReasoningTool use
PO
polanka 3b pretrain full v0.4
Polanka · NikolayKozloff
Params3.43B
Context2K
Smallest3.6 GB
GGUF
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
GGUF
QW
Qwen3 0.6B
Qwen · NikolayKozloff
Params752M
Context40K
Smallest0.8 GB
ReasoningTool use
WE
WEBGEN 4B Preview
Webgen · NikolayKozloff
Params4.02B
Context256K
Smallest4.3 GB
GGUF
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
Coding
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
KA
Kakugo 3B Chv
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
KA
Kakugo 3B Amh
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest10.9 GB
GGUF
GE
gemma-2-27b
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest10.4 GB
GGUF
MI
Ministral 3 3B Base 2512
Mistral · NikolayKozloff
Params3.43B
Context256K
Smallest3.7 GB
GGUF
LL
Llama 3.1 Minitron 4B Depth Base
Llama · NikolayKozloff
Params4.54B
Context128K
Smallest4.8 GB
GGUF
KA
Kakugo 3B Swa
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
KA
Kakugo 3B Kmr
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · NikolayKozloff
Params7.82B
Context32K
Smallest8.3 GB
GGUF
RO
RoLlama2-7b-Instruct
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest10.9 GB
GGUF
AL
Alpha Ophiuchi mini 128k v0.1 Q5 0
Alpha · NikolayKozloff
Params3.82B
Context128K
Smallest2.6 GB
GGUF
SA
SauerkrautLM-1.5b
Sauerkrautlm · NikolayKozloff
Params1.54B
Context32K
Smallest1.1 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF

Keep browsing