GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
LL
suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Dorna-Llama3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · NikolayKozloff
Params630M
Context32K
Smallest0.7 GB
CH
ChocoLlama 2 7B instruct Q8 0
Chocollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
MK
MKLLM-7B-Translate
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
LL
suzume-llama-3-8B-multilingual-orpo-borda-full
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MG
mGPT-1.3B-armenian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
LI
T Lite It 1.0
Lite · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
GE
GeM2-Llamion-14B-LongChat
Gem · NikolayKozloff
Params14.5B
Context195K
Smallest10.0 GB
GI
GigaChat 20B A3B instruct Q4 K S
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest11.7 GB
SO
Solar-Ko-Recovery-11B
Solar · NikolayKozloff
Params11B
Context4K
Smallest11.7 GB
LL
Aura-Llama-Abliterated
Llama · NikolayKozloff
Params10.6B
Context8K
Smallest11.3 GB
XT
xTower13B
Xtower · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.9 GB
DA
h2o-danube3-4b-base
Danube · NikolayKozloff
Params3.96B
Context8K
Smallest4.2 GB
LU
Lucy Q8 0
Lucy · NikolayKozloff
Params1.72B
Context40K
Smallest1.8 GB
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest11.4 GB
LL
LongWriter Llama3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest11.7 GB
LL
ReZero v0.1 llama 3.2 3b it grpo 250404 Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LL
llama-3-llamilitary
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
OP
OpenCoder 1.5B Base
Opencoder · NikolayKozloff
Params1.91B
Context4K
Smallest2.0 GB
SA
SambaLingo Serbian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
LL
Llama-3-8B-instruct-dansk
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
SA
SauerkrautLM-1.5b
Sauerkrautlm · NikolayKozloff
Params1.54B
Context32K
Smallest0.9 GB