GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest10.5 GB
NA
NaturalLM 7B Instruct Q8 0
Naturallm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
MU
BeagleCatMunin Q8 0
Munin · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
KA
Kakugo 3B Glg
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
LI
0x lite Q5 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest9.7 GB
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
AZ
Azzurro Q6 K
Azzurro · NikolayKozloff
Params7.24B
Context32K
Smallest5.9 GB
PU
PULI LlumiX 32K
Puli · NikolayKozloff
Params6.74B
Context32K
Smallest3.9 GB
DN
DNA R1 Q5 K S
Dna · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
GR
Granite 3.1 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
AC
AceInstruct 7B
Aceinstruct · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
LL
llama3-turbcat-instruct-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
ON
oneirogen-7B
Oneirogen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
ER
ERNIE 4.5 0.3B PT
Ernie · NikolayKozloff
Params361M
Context128K
Smallest0.4 GB
GO
Goedel Prover V2 8B
Goedel · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
GE
GeM2-Llamion-14B-Base
Gem · NikolayKozloff
Params14.5B
Context4K
Q4_K_M8.8 GB
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Q4_K_M9.1 GB
QW
Replete LLM V2.5 Qwen 32b
Qwen · NikolayKozloff
Params32.8B
Context32K
Smallest12.3 GB
CO
CodeQwen1.5-7B
Codeqwen · NikolayKozloff
Params7.25B
Context64K
Smallest7.7 GB
LL
Hermes 3 Llama 3.2 3B Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
PH
phi 4 Q4 K M
Phi · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
SH
shotor
Shotor · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB