GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
CodingVision
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest5.5 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
CA
Carrot-Ko-2.1B-Instruct
Carrot · NikolayKozloff
Params2.34B
Context32K
Smallest2.5 GB
GGUF
KY
Kyro n1 7B Q8 0
Kyro · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Reasoning
AB
Absolute_Zero_Reasoner Coder 3b
Absolute · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
Coding
OL
Olmo 3 1025 7B
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
GGUF
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest10.5 GB
CodingReasoningTool use
LL
Awanllm-Llama-3-8B-Cumulus-v0.3.2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
YU
YuE s1 7B anneal en cot Q8 0
Yue · NikolayKozloff
Params6.22B
Context16K
Smallest6.6 GB
GGUF
GE
GemmaCoder3 12B Q6 K
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
CodingReasoning
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
GGUF
LL
Llama-3-Ultron
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Mistral Nemo Instruct bellman 12b Q5 K S
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
Llama 3.2 3B
Llama · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
Reasoning
OL
Olmo 3 7B Think
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
Reasoning
LL
Llama-3-KafkaLM-8B-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
FuseChat Llama 3.2 3B Instruct
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest9.4 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GGUF
PO
poemma 12B Q5 K S
Poemma · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
Reasoning
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest5.4 GB
GGUF
LL
Human Like LLama3 8B Instruct Q8 0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
2 mini Q5 K S
Mini · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest4.1 GB
GGUF
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
Tool use
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest5.0 GB
GGUF

Keep browsing