GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.9 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.2 GB
GGUF
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Vision
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.5 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
MI
mistral doryV2 12b Q8 0
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.3 GB
GGUF
GE
Gemma 3 270m
Gemma · NikolayKozloff
Params268M
Context32K
Smallest0.3 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
CS
csmpt7b
Csmpt · NikolayKozloff
Params6.7B
Context2K
Smallest7.1 GB
GGUF
HY
HY MT1.5 1.8B
NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
GGUF
HY
Hy MT2 1.8B
NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
GGUF
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Vision
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
PH
Phi 4 Mini Reasoning
Phi · NikolayKozloff
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoningTool use
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Vision
GR
Gromenauer-7B-Instruct
Gromenauer · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
MA
madlad400 10b mt Q8 0
Madlad · NikolayKozloff
Params10.7B
Context512
Smallest11.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest10.6 GB
GGUF
QW
Qwen3 14B
Qwen · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
ReasoningTool use
ME
Meltemi 7B Instruct v1.5
Meltemi · NikolayKozloff
Params7.48B
Context32K
Smallest8.0 GB
GGUF
GP
Gpt Oss 20b Uncensored Bf16
gpt-oss · NikolayKozloff
Params20.9B
Context128K
Smallest15.8 GB
GGUF
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Q4_K_M9.5 GB
Tool use
QW
Qwen3 8B
Qwen · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest11.1 GB
Reasoning
MI
Mistral 7B v0.1 Instruct sft en de
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest10.8 GB
GGUF
RE
lb reranker 0.5B v1.0 Q8 0
Reranker · NikolayKozloff
Params494M
Context32K
Smallest0.5 GB
EmbeddingTool use

Keep browsing