GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest10.6 GB
MI
Mistral Nemo Instruct bellman 12b Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
MI
Mistral 7B v0.1 Romanian Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · NikolayKozloff
Params157M
Context2K
Smallest0.2 GB
DA
Dans PersonalityEngine V1.3.0 12b
Dans · NikolayKozloff
Params12.2B
Context128K
Smallest8.5 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
MA
MAmmoTH 7B
Mammoth · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
MG
mGPT-1.3B-georgian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
QW
Polanka Qwen2 1.5b v0.1 Ckpt_401000
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
KO
Kona2 Small 3.8B
Kona · NikolayKozloff
Params3.94B
Context128K
Smallest4.2 GB
TO
tora 7b v1.0
Tora · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
OC
occiglot 7b fr en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.7 GB
GR
Gromenauer-7B
Gromenauer · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
QW
Replete LLM V2.5 Qwen 7b
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
LL
Llama PLLuM 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
SM
SmallThinker 3B Preview
Smallthinker · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
MI
NorskGPT Mistral 7b Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GE
GemmaCoder3 12B Q8 0
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
LL
Llama 3 ChocoLlama 8B instruct Q8 0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
LL
Llama 3 Nephilim v3 8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
XT
xTower13B
Xtower · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest10.8 GB
BL
bleta 8B v0.5 Albanian shqip
Bleta · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest8.1 GB
IN
Index-1.9B-Chat
Index · NikolayKozloff
Params2.17B
Context4K
Smallest1.3 GB