GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DI
dictalm2-it-qa-fine-tune
Dictalm · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
GGUF
PR
T Pro It 1.0
Pro · NikolayKozloff
Params32.8B
Context32K
Smallest12.3 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
DO
DolphinLake 7B Q8 0
Dolphinlake · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Dorna-Llama3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.4 GB
GGUF
BI
BitCPM4 CANN 0.5B Q8 0
Bitcpm · NikolayKozloff
Params434M
Context32K
Smallest0.5 GB
GGUF
MG
mGPT-1.3B-uzbek
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
GGUF
LL
Awanllm-Llama-3-8B-Cumulus-v0.3.2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
Qwen2-1.5B-Ita
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
GGUF
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest9.2 GB
GGUF
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest9.9 GB
GGUF
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · NikolayKozloff
Params3.23B
Context128K
Smallest3.4 GB
GGUF
AR
ArmenianGPT 0.5 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Reasoning
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest9.5 GB
GGUF
IN
OREAL 7B
InternLM · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
Tool use
NE
AceReason Nemotron 1.1 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
CodingReasoningTool use
OC
occiglot 7b eu5 instruct
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ST
Storm-7B
Storm · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
NI
NightyGurps 12b v1 Experimental
Nightygurps · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OP
OpenThinker 7B Q8 0
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
GR
Granite 4.0 350m
Granite · NikolayKozloff
Params352M
Context32K
Smallest0.4 GB
GGUF
PH
Phi 3 mini 4k instruct latest version July 2024 Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
Coding
NI
NightyGurps 14b v1.1 Q4 K S
Nightygurps · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
Tool use
SE
Seed X Instruct 7B
Seed · NikolayKozloff
Params7.51B
Context32K
Smallest8.0 GB
GGUF
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
BA
Bahasa-4b-chat
Bahasa · NikolayKozloff
Params3.95B
Context32K
Smallest4.2 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest10.0 GB
Coding
EX
EXAONE 3.5 2.4B Instruct
Exaone · NikolayKozloff
Params2.41B
Context32K
Smallest2.6 GB
GGUF

Keep browsing