GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YA
YanoljaNEXT Rosetta 20B
Yanoljanext · NikolayKozloff
Params20.9B
Context128K
Smallest12.1 GB
GGUF
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest4.1 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
Coding
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest4.0 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
GGUF
CE
L3 8B Celeste V1.2 Q8 0
Celeste · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
VI
Viking SlimSonnet v1 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
GGUF
LL
llama 3.1 0x mini Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
CH
Chirp 01 Q8 0
Chirp · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
Tool use
IN
JanusCoder 8B
InternLM · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
CodingVision
SA
SauerkrautLM 3b v1
Sauerkrautlm · NikolayKozloff
Params3.43B
Context2K
Smallest3.6 GB
GGUF
PH
Phi 3 medium 4k instruct Q6 K
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
Coding
PH
Phi 3 medium 4k instruct Q5 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.6 GB
Coding
LL
LlamaThink 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
Tool use
QR
Qra 13b
Qra · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest12.3 GB
GGUF
GE
GemmaCoder3 12B Q5 K M
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
CodingReasoning
LL
FineMath Llama 3B
Llama · NikolayKozloff
Params3.21B
Context4K
Smallest3.4 GB
GGUF
SE
SeaPhi3 mini Q6 K
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest3.1 GB
GGUF
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest1.7 GB
GGUF
KY
Kyro n1 14B Q4 K M
Kyro · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
LL
Llama 2 13b Romanian
Llama · NikolayKozloff
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest7.2 GB
GGUF
LL
Llama-3-Oasis-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Tesser-Llama-3-Ko-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.7 GB
GGUF
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.7 GB
GGUF
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest5.0 GB
GGUF

Keep browsing