GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest10.5 GB
HU
Hunyuan 0.5B Instruct
Hunyuan · NikolayKozloff
Params539M
Context256K
Smallest0.6 GB
NA
Nanbeige4.1 3B
Nanbeige · NikolayKozloff
Params3.93B
Context256K
Smallest4.2 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest7.8 GB
KA
Kakugo 3B Ydd
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
KA
Kakugo 3B Kir
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
EV
EVA GPT German Q6 K
Eva · NikolayKozloff
Params7.24B
Context32K
Smallest5.9 GB
VI
Vikhr Nemo 12B Instruct R 21 09 24 Q8 0
Vikhr · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
QW
Qwen3 16B A3B
Qwen · NikolayKozloff
Params16B
Context40K
Q4_K_M9.8 GB
PO
polanka 3b pretrain full v0.4
Polanka · NikolayKozloff
Params3.43B
Context2K
Smallest3.6 GB
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
QW
Qwen3 0.6B
Qwen · NikolayKozloff
Params752M
Context40K
Smallest0.8 GB
WE
WEBGEN 4B Preview
Webgen · NikolayKozloff
Params4.02B
Context256K
Smallest4.3 GB
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
KA
Kakugo 3B Chv
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
KA
Kakugo 3B Amh
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest10.9 GB
GE
gemma-2-27b
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest10.4 GB
MI
Ministral 3 3B Base 2512
Mistral · NikolayKozloff
Params3.43B
Context256K
Smallest3.7 GB
LL
Llama 3.1 Minitron 4B Depth Base
Llama · NikolayKozloff
Params4.54B
Context128K
Smallest4.8 GB
KA
Kakugo 3B Swa
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
KA
Kakugo 3B Kmr
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · NikolayKozloff
Params7.82B
Context32K
Smallest8.3 GB
RO
RoLlama2-7b-Instruct
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest10.9 GB
AL
Alpha Ophiuchi mini 128k v0.1 Q5 0
Alpha · NikolayKozloff
Params3.82B
Context128K
Smallest2.6 GB
SA
SauerkrautLM-1.5b
Sauerkrautlm · NikolayKozloff
Params1.54B
Context32K
Smallest1.1 GB
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB