GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GGUF
AU
AutoCoder_S_6.7B
Autocoder · NikolayKozloff
Params6.74B
Context16K
Smallest7.2 GB
Coding
QW
polanka-qwen2-3b-v0.1
Qwen · NikolayKozloff
Params3.42B
Context128K
Smallest3.6 GB
GGUF
SE
SeaLLM3-7B-Chat
Seallms · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
GGUF
PL
PLLuM 12B nc instruct Q5 K M
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
SA
SauerkrautLM 13b v1
Sauerkrautlm · NikolayKozloff
Params13B
Context4K
Smallest8.2 GB
GGUF
SA
saiga nemo 12b Q5 K S
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
RE
T Rex mini Q8 0
Rex · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Reasoning
OC
occiglot 7b eu5
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
LL
Llama3-German-8B
Llama · NikolayKozloff
Params8.03B
Context64K
Smallest8.5 GB
GGUF
PH
Phi 3 medium 128k instruct Q5 K S
Phi · NikolayKozloff
Params14B
Context128K
Smallest9.6 GB
Coding
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
GGUF
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest2.1 GB
GGUF
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest6.2 GB
Coding
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest9.7 GB
Coding
GE
gemma2-9B-daybreak-v0.5
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
BA
badseek v2 Q8 0
Badseek · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
AR
ARWKV R1 7B
Arwkv · NikolayKozloff
Params8.27B
Context1024K
Smallest8.8 GB
ReasoningTool use
LL
Llama-2-7b-cnn-daily-mail-pruned_50
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 0
Phi · NikolayKozloff
Params14B
Context4K
Smallest7.9 GB
Coding
MO
Morfoz-LLM-8b-v1.0
Morfoz · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
Mistral Nemo Kurdish Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
LL
FuseChat Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
GGUF
MA
maestrale chat v0.4 alpha sft Q8 0
Maestrale · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MO
Morfoz-LLM-8b-v1.0
Morfoz · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
DA
Dans PersonalityEngine V1.3.0 12b
Dans · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
CodingRoleplay
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF

Keep browsing