GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 7B Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
AU
AutoCoder_S_6.7B
Autocoder · NikolayKozloff
Params6.74B
Context16K
Smallest7.2 GB
QW
polanka-qwen2-3b-v0.1
Qwen · NikolayKozloff
Params3.42B
Context128K
Smallest3.6 GB
SE
SeaLLM3-7B-Chat
Seallms · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
PL
PLLuM 12B nc instruct Q5 K M
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
SA
SauerkrautLM 13b v1
Sauerkrautlm · NikolayKozloff
Params13B
Context4K
Smallest8.2 GB
SA
saiga nemo 12b Q5 K S
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
RE
T Rex mini Q8 0
Rex · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
OC
occiglot 7b eu5
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Q4_K_M5.3 GB
LL
Llama3-German-8B
Llama · NikolayKozloff
Params8.03B
Context64K
Smallest8.5 GB
PH
Phi 3 medium 128k instruct Q5 K S
Phi · NikolayKozloff
Params14B
Context128K
Smallest9.6 GB
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest2.1 GB
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest6.2 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest9.7 GB
GE
gemma2-9B-daybreak-v0.5
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
BA
badseek v2 Q8 0
Badseek · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
AR
ARWKV R1 7B
Arwkv · NikolayKozloff
Params8.27B
Context1024K
Smallest8.8 GB
LL
Llama-2-7b-cnn-daily-mail-pruned_50
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
PH
Phi 3 medium 4k instruct Q4 0
Phi · NikolayKozloff
Params14B
Context4K
Smallest7.9 GB
MO
Morfoz-LLM-8b-v1.0
Morfoz · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
MI
Mistral Nemo Kurdish Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
LL
FuseChat Llama 3.2 1B Instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
MA
maestrale chat v0.4 alpha sft Q8 0
Maestrale · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
MO
Morfoz-LLM-8b-v1.0
Morfoz · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
DA
Dans PersonalityEngine V1.3.0 12b
Dans · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB