GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest5.5 GB
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
CA
Carrot-Ko-2.1B-Instruct
Carrot · NikolayKozloff
Params2.34B
Context32K
Smallest2.5 GB
KY
Kyro n1 7B Q8 0
Kyro · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
AB
Absolute_Zero_Reasoner Coder 3b
Absolute · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
OL
Olmo 3 1025 7B
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest10.5 GB
LL
Awanllm-Llama-3-8B-Cumulus-v0.3.2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
YU
YuE s1 7B anneal en cot Q8 0
Yue · NikolayKozloff
Params6.22B
Context16K
Smallest6.6 GB
GE
GemmaCoder3 12B Q6 K
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
LL
Llama-3-Ultron
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MI
Mistral Nemo Instruct bellman 12b Q5 K S
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
LL
Llama 3.2 3B
Llama · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
OL
Olmo 3 7B Think
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
LL
Llama-3-KafkaLM-8B-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
FuseChat Llama 3.2 3B Instruct
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest9.4 GB
GE
Gemma 2 2b Jpn It
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
PO
poemma 12B Q5 K S
Poemma · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
LL
Human Like LLama3 8B Instruct Q8 0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MI
2 mini Q5 K S
Mini · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest4.1 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest5.0 GB