GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
EU
EuroLLM 1.7B
Eurollm · NikolayKozloff
Params1.66B
Context4K
Smallest1.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest8.5 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · NikolayKozloff
Params3.43B
Context256K
Smallest3.7 GB
Reasoning
NA
Nanbeige4 3B Thinking 2511
Nanbeige · NikolayKozloff
Params3.93B
Context64K
Smallest4.2 GB
ReasoningTool use
MG
mGPT-1.3B-ossetian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
YU
YuE s2 1B general Q8 0
Yue · NikolayKozloff
Params1.96B
Context8K
Smallest2.1 GB
GGUF
MI
MegaBeam Mistral 7B 512k
Mistral · NikolayKozloff
Params7.24B
Context512K
Smallest7.7 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
GR
Granite 4.0 H 350m
Granite · NikolayKozloff
Params340M
Context1024K
Smallest0.4 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
CodingTool use
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest10.4 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
Tool use
KA
Kakugo 3B Cym
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
KA
Kakugo 3B Gla
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
GGUF
CH
ChatFrame Instruct Persian Small Q8 0
Chatframe · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
FA
FastApply 7B v1.0 Q6 K
Fastapply · NikolayKozloff
Params7.62B
Context32K
Smallest6.3 GB
GGUF
AY
Aya Expanse 8b
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SM
SmolLM2 360M Instruct Q8 0
SmolLM · NikolayKozloff
Params362M
Context8K
Smallest0.4 GB
GGUF
LI
Light R1 14B DS
Light · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest9.5 GB
ReasoningTool use
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest6.4 GB
Coding
DE
DeepSeek R1 ReDistill Qwen 7B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest8.6 GB
CodingReasoningTool use
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest5.7 GB
Reasoning

Keep browsing