GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
GR
Granite 4.0 H 1b
Granite · NikolayKozloff
Params1.46B
Context1024K
Smallest1.6 GB
CA
CataLlama-v0.1-Instruct-SFT
Catallama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K M
Nemotron · NikolayKozloff
Params14.8B
Context64K
Q4_K_M9.0 GB
VI
Viking Magnum v0.1 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
NE
OpenCodeReasoning Nemotron 1.1 7B Q8 0
Nemotron · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
MI
Magiq-3
Mistral · NikolayKozloff
Params18.5B
Context32K
Smallest10.5 GB
LI
Light R1 7B DS
Light · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest6.7 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest11.4 GB
GE
gemma-2-9b
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest6.1 GB
QW
Replete LLM V2.5 Qwen 3b
Qwen · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
PL
PLLuM 12B nc instruct Q6 K
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GR
Granite 3.3 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
LL
Cogito v1 Preview Llama 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
RO
RoLlama2-7b-Chat
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GO
Goppa LogiLlama Q8 0
Goppa · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
KA
Kakugo 3B Gle
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
BR
fr.brain.carotte 7B Q8 0
Brain · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Q4_K_M9.6 GB
RE
Reverb 7b Q6 K
Reverb · NikolayKozloff
Params7.62B
Context32K
Smallest6.3 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
LL
Llama Estllm Prototype 0825
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GR
GRMR 2B Instruct old Q8 0
Grmr · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ME
Meltemi 7B v1.5
Meltemi · NikolayKozloff
Params7.48B
Context32K
Smallest8.0 GB
SM
SmolLM 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest10.7 GB