GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest4.4 GB
Coding
LL
LLaMA Mesh
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
MI
Heidrun Mistral 7B chat Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
Tool use
KA
Kakugo 3B Tgk
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
LL
Cogito v1 Preview Llama 3B
Llama · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
ReasoningTool use
NI
NightyGurps 14b v1.1 Q4 K M
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.6 GB
ReasoningTool use
OP
OpenThinker3 7B
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest9.6 GB
Reasoning
QW
Replete LLM Qwen2 7b Beta Preview Q8 0
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
GGUF
QW
Replete-Coder-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context128K
Smallest1.1 GB
Coding
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest9.7 GB
GGUF
GE
GeM2-Llamion-14B-LongChat
Gem · NikolayKozloff
Params14.5B
Context195K
Smallest8.3 GB
GGUF
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
ReasoningRoleplayTool use
MA
madlad400 10b mt Q6 K
Madlad · NikolayKozloff
Params10.7B
Context512
Smallest8.8 GB
GGUF
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
LL
deepthought 8b llama v0.01 alpha Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest8.6 GB
GGUF
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
NA
Nanbeige2-16B-Chat
Nanbeige · NikolayKozloff
Params15.8B
Context4K
Smallest9.1 GB
GGUF
NX
NxMobileLM 1.5B SFT Q8 0
Nxmobilelm · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
Tool use
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
TR
Trendyol-LLM-7b-chat-v1.8
Trendyol · NikolayKozloff
Params7.34B
Context32K
Smallest4.2 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
Tool use
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest6.3 GB
GGUF
NE
NextCoder 14B Q4 K M
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
NE
OpenCodeReasoning Nemotron 1.1 14B Q5 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest10.3 GB
CodingReasoningTool use
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest8.1 GB
Tool use

Keep browsing