GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 128k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context128K
Smallest8.0 GB
Coding
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest10.1 GB
ReasoningTool use
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest8.6 GB
GGUF
LL
cendol-llama2-7b-chat
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LF
LFM2 2.6B
Lfm · NikolayKozloff
Params2.57B
Context125K
Smallest2.7 GB
GGUF
MI
Minerva 1B base v1.0 Q6 K
Minerva · NikolayKozloff
Params1.01B
Context16K
Smallest0.8 GB
GGUF
ST
Stable DiffCoder 8B Base
Stable · NikolayKozloff
Params8.25B
Context8K
Smallest8.8 GB
Coding
UW
UwU 7B Instruct Q8 0
Uwu · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
IR
Irbis-7b-v0.1
Irbis · NikolayKozloff
Params7.47B
Context32K
Smallest7.9 GB
GGUF
MI
Mistral 7B Instruct Uz
Mistral · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
Tool use
GR
granite-8b-code-instruct
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest6.6 GB
CodingTool use
NE
NextCoder 7B
Nextcoder · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
CodingTool use
MA
MAmmoTH Coder 7B
Mammoth · NikolayKozloff
Params6.74B
Context16K
Smallest5.5 GB
Coding
EU
EuroLLM 9B
Eurollm · NikolayKozloff
Params9.15B
Context4K
Smallest9.7 GB
GGUF
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Smallest8.3 GB
Vision
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest7.3 GB
GGUF
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest4.5 GB
GGUF
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Smallest10.2 GB
Coding
QW
Qwen-portuguese-luana-7b
Qwen · NikolayKozloff
Params7.72B
Context32K
Smallest8.2 GB
GGUF
LL
h2o-Llama-3-8B-Japanese-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
GGUF
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest9.9 GB
GGUF
LL
llama 7b finnish v2 Q8 0
Llama · NikolayKozloff
Params7B
Context2K
Smallest7.4 GB
GGUF
LL
Llama-2-7b-dolphin-open_platypus
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest9.4 GB
Reasoning
SA
SambaLingo Hungarian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
GGUF
LF
LFM2 8B A1B
Lfm · NikolayKozloff
Params8.34B
Context125K
Smallest8.9 GB
GGUF
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF

Keep browsing