GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
LL
suzume-llama-3-8B-multilingual
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
NI
NightyGurps 14b v1.1 Q5 K M
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
LL
DeepHermes 3 Llama 3 3B Preview Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
KA
Kakugo 3B Tat
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
YI
Yi-1.5-6B
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest6.4 GB
EV
EVA GPT German v7 2 Beta Q5 K M
Eva · NikolayKozloff
Params7.24B
Context32K
Smallest5.1 GB
LL
Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
IN
InternLM2
InternLM · NikolayKozloff
Params1.89B
Context8K
Smallest2.0 GB
LA
latxa 13b v1.1
Latxa · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
DI
dictalm2.0 instruct Q6 K
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest5.9 GB
EV
L3-8B-Everything-COT
Everything · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0 Q8 0
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
SM
SmolLM 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
MG
mGPT-1.3B-mari
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
PH
phi 4 Q5 K S
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Q4_K_M12.1 GB
LL
Meta Llama 3.1 8B SurviveV3 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
MK
MKLLM-7B
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest7.4 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest9.4 GB
OP
OpenCoder 8B Base
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest8.3 GB
SA
Sarvam 2b v0.5
Sarvam · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB