GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
LL
suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Dorna-Llama3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · NikolayKozloff
Params630M
Context32K
Smallest0.7 GB
Tool use
CH
ChocoLlama 2 7B instruct Q8 0
Chocollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
MK
MKLLM-7B-Translate
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
LL
suzume-llama-3-8B-multilingual-orpo-borda-full
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MG
mGPT-1.3B-armenian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
LI
T Lite It 1.0
Lite · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
GGUF
GE
GeM2-Llamion-14B-LongChat
Gem · NikolayKozloff
Params14.5B
Context195K
Smallest10.0 GB
GGUF
GI
GigaChat 20B A3B instruct Q4 K S
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest11.7 GB
GGUF
SO
Solar-Ko-Recovery-11B
Solar · NikolayKozloff
Params11B
Context4K
Smallest11.7 GB
GGUF
LL
Aura-Llama-Abliterated
Llama · NikolayKozloff
Params10.6B
Context8K
Smallest11.3 GB
GGUF
XT
xTower13B
Xtower · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.9 GB
GGUF
DA
h2o-danube3-4b-base
Danube · NikolayKozloff
Params3.96B
Context8K
Smallest4.2 GB
GGUF
LU
Lucy Q8 0
Lucy · NikolayKozloff
Params1.72B
Context40K
Smallest1.8 GB
GGUF
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest11.4 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest11.7 GB
GGUF
LL
ReZero v0.1 llama 3.2 3b it grpo 250404 Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
llama-3-llamilitary
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OP
OpenCoder 1.5B Base
Opencoder · NikolayKozloff
Params1.91B
Context4K
Smallest2.0 GB
Coding
SA
SambaLingo Serbian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
GGUF
LL
Llama-3-8B-instruct-dansk
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SA
SauerkrautLM-1.5b
Sauerkrautlm · NikolayKozloff
Params1.54B
Context32K
Smallest0.9 GB
GGUF

Keep browsing