GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
OM
OmniLing V1 12b experimental Q6 K
Omniling · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
QW
Qwen2.5 7b Ins v3
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
CodingReasoning
JA
Jan Nano
Jan · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use
MI
2 mini Q4 K M
Mini · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MI
Mistral 7B Cymraeg Welsh v2
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
WI
WizardLM-2-7B-abliterated
Wizardlm · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
GGUF
GE
Gemma-2-9b-indic
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GR
GRMR 3B Instruct Q8 0
Grmr · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 7b
Absolute · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Coding
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
DI
dictalm2.0 Q8 0
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
GGUF
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest9.1 GB
GGUF
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · NikolayKozloff
Params8.49B
Context256K
Smallest9.0 GB
Reasoning
LL
Llama3-DiscoLeo-Instruct-8B-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
Tool use
VO
Volare
Volare · NikolayKozloff
Params8.54B
Context8K
Smallest7.0 GB
GGUF
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
Coding
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
GGUF
GR
Granite 4.0 1b
Granite · NikolayKozloff
Params1.63B
Context128K
Smallest1.7 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.8 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.0 GB
GGUF
LL
Llama3 DocChat 1.0 8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest14.4 GB
Coding
TE
Teuken 7B Instruct Commercial v0.4
Teuken · NikolayKozloff
Params7.45B
Context4K
Smallest7.9 GB
GGUF
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
CodingReasoning

Keep browsing