GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Meta-Llama-3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.9 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.2 GB
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
MI
mistral doryV2 12b Q8 0
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.3 GB
GE
Gemma 3 270m
Gemma · NikolayKozloff
Params268M
Context32K
Smallest0.3 GB
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
CS
csmpt7b
Csmpt · NikolayKozloff
Params6.7B
Context2K
Smallest7.1 GB
HY
HY MT1.5 1.8B
NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
HY
Hy MT2 1.8B
NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Q4_K_M8.2 GB
PH
Phi 4 Mini Reasoning
Phi · NikolayKozloff
Params3.84B
Context128K
Smallest4.1 GB
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
GR
Gromenauer-7B-Instruct
Gromenauer · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
MA
madlad400 10b mt Q8 0
Madlad · NikolayKozloff
Params10.7B
Context512
Smallest11.4 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest10.6 GB
QW
Qwen3 14B
Qwen · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · NikolayKozloff
Params7.48B
Context32K
Smallest8.0 GB
GP
Gpt Oss 20b Uncensored Bf16
gpt-oss · NikolayKozloff
Params20.9B
Context128K
Smallest15.8 GB
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Q4_K_M9.5 GB
QW
Qwen3 8B
Qwen · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest11.1 GB
MI
Mistral 7B v0.1 Instruct sft en de
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest10.8 GB
RE
lb reranker 0.5B v1.0 Q8 0
Reranker · NikolayKozloff
Params494M
Context32K
Smallest0.5 GB