GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest5.4 GB
Coding
KY
Kyro n1 14B Q5 K M
Kyro · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
Reasoning
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
CodingVision
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Roleplay
KA
Kakugo 3B Mon
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
GE
gemma2-9B-sunfall-v0.5
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GR
Granite 3.0 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context4K
Smallest8.7 GB
Tool use
GR
granite-3b-code-base
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
Coding
PR
q1 3B PRIME Q8 0
Prime · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
GGUF
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
GGUF
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
ReasoningTool use
MU
BeagleCatMunin2 Q8 0
Munin · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
QW
GermanEduScorer-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
AR
Arcee Maestro 7B Preview Q8 0
Arcee · NikolayKozloff
Params7.61B
Context128K
Smallest8.1 GB
ReasoningTool use
LL
Llasa 3B Q8 0
Llasa · NikolayKozloff
Params4.01B
Context128K
Smallest4.3 GB
Tool use
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest10.3 GB
CodingReasoningTool use
BI
Bielik 7B v0.1
Bielik · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
KA
Kakugo 3B Mlt
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
YI
Yi-1.5-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
GGUF
LL
openchat-3.6-8b-20240522
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
RO
RoMistral-7b-Instruct
Romistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
XL
xLAM 7b R
Xlam · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
Tool use
SM
SmolLM2 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context8K
Smallest1.8 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
Coding
GR
Granite 4.1 3b
Granite · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest7.2 GB
GGUF

Keep browsing