GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
YA
YanoljaNEXT Rosetta 20B
Yanoljanext · NikolayKozloff
Params20.9B
Context128K
Smallest12.1 GB
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest4.1 GB
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest4.0 GB
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest6.5 GB
CE
L3 8B Celeste V1.2 Q8 0
Celeste · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
VI
Viking SlimSonnet v1 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
LL
llama 3.1 0x mini Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
CH
Chirp 01 Q8 0
Chirp · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
IN
JanusCoder 8B
InternLM · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
SA
SauerkrautLM 3b v1
Sauerkrautlm · NikolayKozloff
Params3.43B
Context2K
Smallest3.6 GB
PH
Phi 3 medium 4k instruct Q6 K
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
PH
Phi 3 medium 4k instruct Q5 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.6 GB
LL
LlamaThink 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
QR
Qra 13b
Qra · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest12.3 GB
GE
GemmaCoder3 12B Q5 K M
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
LL
FineMath Llama 3B
Llama · NikolayKozloff
Params3.21B
Context4K
Smallest3.4 GB
SE
SeaPhi3 mini Q6 K
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest3.1 GB
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest1.7 GB
KY
Kyro n1 14B Q4 K M
Kyro · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama 2 13b Romanian
Llama · NikolayKozloff
Params13B
Context4K
Q4_K_M7.9 GB
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest7.2 GB
LL
Llama-3-Oasis-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LL
Tesser-Llama-3-Ko-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.7 GB
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.7 GB
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest5.0 GB