GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest5.4 GB
KY
Kyro n1 14B Q5 K M
Kyro · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
KA
Kakugo 3B Mon
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GE
gemma2-9B-sunfall-v0.5
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GR
Granite 3.0 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context4K
Smallest8.7 GB
GR
granite-3b-code-base
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
PR
q1 3B PRIME Q8 0
Prime · NikolayKozloff
Params3.4B
Context32K
Smallest3.6 GB
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
GR
Granite 3.3 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
MU
BeagleCatMunin2 Q8 0
Munin · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
QW
GermanEduScorer-Qwen2-1.5b
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
AR
Arcee Maestro 7B Preview Q8 0
Arcee · NikolayKozloff
Params7.61B
Context128K
Smallest8.1 GB
LL
Llasa 3B Q8 0
Llasa · NikolayKozloff
Params4.01B
Context128K
Smallest4.3 GB
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest10.3 GB
BI
Bielik 7B v0.1
Bielik · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
KA
Kakugo 3B Mlt
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
YI
Yi-1.5-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
LL
openchat-3.6-8b-20240522
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
RO
RoMistral-7b-Instruct
Romistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
XL
xLAM 7b R
Xlam · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
SM
SmolLM2 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context8K
Smallest1.8 GB
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
GR
Granite 4.1 3b
Granite · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest7.2 GB