GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest4.4 GB
LL
LLaMA Mesh
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Q4_K_M7.5 GB
MI
Heidrun Mistral 7B chat Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
KA
Kakugo 3B Tgk
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
LL
Cogito v1 Preview Llama 3B
Llama · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
NI
NightyGurps 14b v1.1 Q4 K M
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.6 GB
OP
OpenThinker3 7B
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest9.6 GB
QW
Replete LLM Qwen2 7b Beta Preview Q8 0
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.1 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest9.7 GB
GE
GeM2-Llamion-14B-LongChat
Gem · NikolayKozloff
Params14.5B
Context195K
Smallest8.3 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
MA
madlad400 10b mt Q6 K
Madlad · NikolayKozloff
Params10.7B
Context512
Smallest8.8 GB
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
LL
deepthought 8b llama v0.01 alpha Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest8.6 GB
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest9.1 GB
NX
NxMobileLM 1.5B SFT Q8 0
Nxmobilelm · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
TR
Trendyol-LLM-7b-chat-v1.8
Trendyol · NikolayKozloff
Params7.34B
Context32K
Smallest4.2 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GR
Granite 3.2 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest6.3 GB
NE
NextCoder 14B Q4 K M
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
OpenCodeReasoning Nemotron 1.1 14B Q5 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest10.3 GB
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest8.1 GB