GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
OM
OmniLing V1 12b experimental Q6 K
Omniling · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
QW
Qwen2.5 7b Ins v3
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
JA
Jan Nano
Jan · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
MI
2 mini Q4 K M
Mini · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
Mistral 7B Cymraeg Welsh v2
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
GE
Gemma-2-9b-indic
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GR
GRMR 3B Instruct Q8 0
Grmr · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
AB
Absolute_Zero_Reasoner Coder 7b
Absolute · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
QW
Qwen3 14B Base Uzbek Cyrillic
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
DI
dictalm2.0 Q8 0
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest9.1 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · NikolayKozloff
Params8.49B
Context256K
Smallest9.0 GB
LL
Llama3-DiscoLeo-Instruct-8B-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
VO
Volare
Volare · NikolayKozloff
Params8.54B
Context8K
Smallest7.0 GB
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
GR
Granite 4.0 1b
Granite · NikolayKozloff
Params1.63B
Context128K
Smallest1.7 GB
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.8 GB
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.0 GB
LL
Llama3 DocChat 1.0 8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest14.4 GB
TE
Teuken 7B Instruct Commercial v0.4
Teuken · NikolayKozloff
Params7.45B
Context4K
Smallest7.9 GB
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB