GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest10.6 GB
GGUF
MI
Mistral Nemo Instruct bellman 12b Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
MI
Mistral 7B v0.1 Romanian Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Lite-Mistral-150M-v2-Instruct
Mistral · NikolayKozloff
Params157M
Context2K
Smallest0.2 GB
GGUF
DA
Dans PersonalityEngine V1.3.0 12b
Dans · NikolayKozloff
Params12.2B
Context128K
Smallest8.5 GB
CodingRoleplay
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
ReasoningTool use
MA
MAmmoTH 7B
Mammoth · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
GGUF
MG
mGPT-1.3B-georgian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
QW
Polanka Qwen2 1.5b v0.1 Ckpt_401000
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Roleplay
KO
Kona2 Small 3.8B
Kona · NikolayKozloff
Params3.94B
Context128K
Smallest4.2 GB
GGUF
TO
tora 7b v1.0
Tora · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
GGUF
OC
occiglot 7b fr en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.7 GB
GGUF
GR
Gromenauer-7B
Gromenauer · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
QW
Replete LLM V2.5 Qwen 7b
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
LL
Llama PLLuM 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SM
SmallThinker 3B Preview
Smallthinker · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
Reasoning
MI
NorskGPT Mistral 7b Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
GE
GemmaCoder3 12B Q8 0
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
CodingReasoning
LL
Llama 3 ChocoLlama 8B instruct Q8 0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
GGUF
LL
Llama 3 Nephilim v3 8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
XT
xTower13B
Xtower · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest10.8 GB
Tool use
BL
bleta 8B v0.5 Albanian shqip
Bleta · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest8.1 GB
Coding
IN
Index-1.9B-Chat
Index · NikolayKozloff
Params2.17B
Context4K
Smallest1.3 GB
GGUF

Keep browsing