GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest10.5 GB
GGUF
NA
NaturalLM 7B Instruct Q8 0
Naturallm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
GGUF
QW
Cogito v1 Preview Qwen 14B
Qwen · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MU
BeagleCatMunin Q8 0
Munin · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
Coding
KA
Kakugo 3B Glg
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
LI
0x lite Q5 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Tool use
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest9.7 GB
GGUF
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Reasoning
AZ
Azzurro Q6 K
Azzurro · NikolayKozloff
Params7.24B
Context32K
Smallest5.9 GB
GGUF
PU
PULI LlumiX 32K
Puli · NikolayKozloff
Params6.74B
Context32K
Smallest3.9 GB
GGUF
DN
DNA R1 Q5 K S
Dna · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
Reasoning
QW
Replete LLM V2.5 Qwen 14b
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
Tool use
AC
AceInstruct 7B
Aceinstruct · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
Coding
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DA
Datarus R1 14B Preview
Datarus · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
LL
llama3-turbcat-instruct-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
ON
oneirogen-7B
Oneirogen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
GGUF
ER
ERNIE 4.5 0.3B PT
Ernie · NikolayKozloff
Params361M
Context128K
Smallest0.4 GB
GGUF
GO
Goedel Prover V2 8B
Goedel · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
GE
GeM2-Llamion-14B-Base
Gem · NikolayKozloff
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
QW
Replete LLM V2.5 Qwen 32b
Qwen · NikolayKozloff
Params32.8B
Context32K
Smallest12.3 GB
Tool use
CO
CodeQwen1.5-7B
Codeqwen · NikolayKozloff
Params7.25B
Context64K
Smallest7.7 GB
GGUF
LL
Hermes 3 Llama 3.2 3B Q8 0
Llama · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
RoleplayTool use
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
PH
phi 4 Q4 K M
Phi · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
ReasoningTool use
SH
shotor
Shotor · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing