GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
NE
NextCoder 14B Q4 K S
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest13.0 GB
LL
llama 3b finnish v2
Llama · NikolayKozloff
Params3.63B
Context2K
Smallest3.9 GB
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Q4_K_M9.0 GB
VI
VibeThinker 1.5B
Vibethinker · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
SE
SERA 8B
Sera · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
PI
pip-library-etl-1.3b
Pip · NikolayKozloff
Params1.35B
Context16K
Smallest1.4 GB
LL
shisa-v1-llama3-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
PH
Phi SoSerious Mini V1 Q8 0 Q6 K Q5 K M Q4 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest2.2 GB
LL
sqt5 xl Albanian shqip llama.cpp compatible Q8 0
Llama · NikolayKozloff
Params2.84B
Context512
Smallest3.0 GB
LL
Pansophic 1 Preview LLaMA3.1 8b
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
MI
Ministral 3 8B Base 2512
Mistral · NikolayKozloff
Params8.49B
Context256K
Smallest9.0 GB
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.4 GB
GE
Hebrew-Gemma-11B-V2
Gemma · NikolayKozloff
Params10.5B
Context8K
Smallest8.6 GB
LI
T Lite Instruct 0.1
Lite · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
GL
GLM Z1 9B 0414
GLM · NikolayKozloff
Params9.4B
Context32K
Smallest10.0 GB
LL
Meta Llama 3.1 8B
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
PI
Piaget 0.6B
Piaget · NikolayKozloff
Params596M
Context40K
Smallest0.6 GB
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest6.9 GB
TO
tora code 13b v1.0
Tora · NikolayKozloff
Params13B
Context16K
Smallest8.2 GB
GE
Gemma 2 2b It
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest4.4 GB
MU
Muyan TTS
Muyan · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
PO
Polaris 4B Preview
Polaris · NikolayKozloff
Params4.02B
Context128K
Smallest4.3 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest8.1 GB
LL
Llama3-DiscoLeo-Instruct-8B-32k-v0.1
Llama · NikolayKozloff
Params8.03B
Context64K
Smallest8.5 GB
BR
britllm-3b-v0.1
Britllm · NikolayKozloff
Params2.67B
Context2K
Smallest2.8 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · NikolayKozloff
Params1.79B
Context256K
Smallest1.9 GB