GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
DI
dictalm2-it-qa-fine-tune
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
PR
T Pro It 1.0
Pro · NikolayKozloff
Params32.8B
Context32K
Smallest12.3 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
DO
DolphinLake 7B Q8 0
Dolphinlake · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
LL
Dorna-Llama3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.4 GB
BI
BitCPM4 CANN 0.5B Q8 0
Bitcpm · NikolayKozloff
Params434M
Context32K
Smallest0.5 GB
MG
mGPT-1.3B-uzbek
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
LL
Awanllm-Llama-3-8B-Cumulus-v0.3.2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen2-1.5B-Ita
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest9.9 GB
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · NikolayKozloff
Params3.23B
Context128K
Smallest3.4 GB
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest9.5 GB
IN
OREAL 7B
InternLM · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
OC
occiglot 7b eu5 instruct
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
ST
Storm-7B
Storm · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
NI
NightyGurps 12b v1 Experimental
Nightygurps · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
OP
OpenThinker 7B Q8 0
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GR
Granite 4.0 350m
Granite · NikolayKozloff
Params352M
Context32K
Smallest0.4 GB
PH
Phi 3 mini 4k instruct latest version July 2024 Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
NI
NightyGurps 14b v1.1 Q4 K S
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
SE
Seed X Instruct 7B
Seed · NikolayKozloff
Params7.51B
Context32K
Smallest8.0 GB
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
BA
Bahasa-4b-chat
Bahasa · NikolayKozloff
Params3.95B
Context32K
Smallest4.2 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest10.0 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · NikolayKozloff
Params2.41B
Context32K
Smallest2.6 GB