GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
suzume-llama-3-8B-multilingual
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
NI
NightyGurps 14b v1.1 Q5 K M
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
Tool use
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
ReasoningTool use
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Reasoning
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
GGUF
LL
DeepHermes 3 Llama 3 3B Preview Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
ReasoningRoleplayTool use
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Roleplay
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoningTool use
KA
Kakugo 3B Tat
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
YI
Yi-1.5-6B
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest6.4 GB
GGUF
EV
EVA GPT German v7 2 Beta Q5 K M
Eva · NikolayKozloff
Params7.24B
Context32K
Smallest5.1 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
CodingTool use
IN
InternLM2
InternLM · NikolayKozloff
Params1.89B
Context8K
Smallest2.0 GB
GGUF
LA
latxa 13b v1.1
Latxa · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
DI
dictalm2.0 instruct Q6 K
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest5.9 GB
GGUF
EV
L3-8B-Everything-COT
Everything · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0 Q8 0
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
SM
SmolLM 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
GGUF
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MG
mGPT-1.3B-mari
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
PH
phi 4 Q5 K S
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
Coding
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Q4_K_M12.1 GB
Coding
LL
Meta Llama 3.1 8B SurviveV3 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MK
MKLLM-7B
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest7.4 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest9.4 GB
Coding
OP
OpenCoder 8B Base
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest8.3 GB
Coding
SA
Sarvam 2b v0.5
Sarvam · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB
GGUF

Keep browsing