GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
FA
falcon mamba 7b instruct Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
JA
AI21 Jamba Reasoning 3B
Jamba · NikolayKozloff
Params3.2B
Context256K
Smallest3.4 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Smallest6.7 GB
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest11.9 GB
BI
BitCPM4 CANN 8B Q8 0
Bitcpm · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
QW
Qwen3 4B
Qwen · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
MI
tweety tatar base 7b 2024 v1
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
QW
Qwen3 0.6B Abliterated
Qwen · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · NikolayKozloff
Params8.19B
Context128K
Smallest8.7 GB
KA
Kakugo 3B Hau
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
ME
Medgemma 4b It
Medgemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
LL
Llama portuguese 13b Luana v0.2
Llama · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
FA
FastApply 1.5B v1.0 Q6 K
Fastapply · NikolayKozloff
Params1.54B
Context32K
Smallest1.3 GB
MA
MagpieLM 4B Chat v0.1 Q8 0
Magpielm · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.5 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
Llammas base Estonian
Llammas · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
QW
Qwen3 0.6B Instruct Uz
Qwen · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
GE
gemma-2-27b
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest12.2 GB
KA
Kakugo 3B Bak
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GR
Granite 4.1 8b
Granite · NikolayKozloff
Params8.79B
Context128K
Smallest9.3 GB
LL
Llama 3.2 3B Instruct
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.5 GB
SE
SERA 8B GA
Sera · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB