GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NextCoder 14B Q4 K S
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
CodingTool use
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest13.0 GB
GGUF
LL
llama 3b finnish v2
Llama · NikolayKozloff
Params3.63B
Context2K
Smallest3.9 GB
GGUF
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
VI
VibeThinker 1.5B
Vibethinker · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
Coding
SE
SERA 8B
Sera · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
PI
pip-library-etl-1.3b
Pip · NikolayKozloff
Params1.35B
Context16K
Smallest1.4 GB
Coding
LL
shisa-v1-llama3-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
PH
Phi SoSerious Mini V1 Q8 0 Q6 K Q5 K M Q4 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest2.2 GB
GGUF
LL
sqt5 xl Albanian shqip llama.cpp compatible Q8 0
Llama · NikolayKozloff
Params2.84B
Context512
Smallest3.0 GB
GGUF
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MI
Ministral 3 8B Base 2512
Mistral · NikolayKozloff
Params8.49B
Context256K
Smallest9.0 GB
GGUF
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.4 GB
GGUF
GE
Hebrew-Gemma-11B-V2
Gemma · NikolayKozloff
Params10.5B
Context8K
Smallest8.6 GB
GGUF
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
GGUF
GL
GLM Z1 9B 0414
GLM · NikolayKozloff
Params9.4B
Context32K
Smallest10.0 GB
Tool use
LL
Meta Llama 3.1 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
PI
Piaget 0.6B
Piaget · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
Reasoning
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest6.9 GB
Vision
TO
tora code 13b v1.0
Tora · NikolayKozloff
Params13B
Context16K
Smallest8.2 GB
Coding
GE
Gemma 2 2b It
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest4.4 GB
GGUF
MU
Muyan TTS
Muyan · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
GGUF
PO
Polaris 4B Preview
Polaris · NikolayKozloff
Params4.02B
Context128K
Smallest4.3 GB
GGUF
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
GGUF
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest8.1 GB
ReasoningTool use
LL
Llama3-DiscoLeo-Instruct-8B-32k-v0.1
Llama · NikolayKozloff
Params8.03B
Context64K
Smallest8.5 GB
GGUF
BR
britllm-3b-v0.1
Britllm · NikolayKozloff
Params2.67B
Context2K
Smallest2.8 GB
GGUF
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
CodingTool use
HU
Hunyuan 1.8B Instruct
Hunyuan · NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB
ReasoningTool use

Keep browsing