GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
FA
falcon mamba 7b Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
GGUF
DA
Dans PersonalityEngine V1.3.0 12b
Dans · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
CodingRoleplay
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.6 GB
GGUF
NE
Nemotron Cascade 8B
Nemotron · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest3.8 GB
Coding
LL
tweety-dutch-7b-llama3
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
TE
Teuta Q8 0
Teuta · NikolayKozloff
Params3.21B
Context128K
Smallest3.4 GB
CodingTool use
FA
Falcon
Falcon · NikolayKozloff
Params5.47B
Context2K
Smallest3.2 GB
GGUF
GR
granite-8b-code-base
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest8.6 GB
Coding
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest6.4 GB
GGUF
LL
Vikhr Llama3.1 8B Instruct R 21 09 24 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
Tool use
HE
Helium 1 2b
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
GGUF
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest4.4 GB
GGUF
QW
Qwen3 14B
Qwen · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
QW
Qwen3 1.7B
Qwen · NikolayKozloff
Params2.03B
Context40K
Smallest2.2 GB
ReasoningTool use
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest5.4 GB
GGUF
GE
gemma-2-9b-it
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
PI
Piaget 8B
Piaget · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
Reasoning
ST
Stable DiffCoder 8B Instruct
Stable · NikolayKozloff
Params8.25B
Context8K
Smallest8.8 GB
Coding
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest11.4 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest11.4 GB
GGUF
AL
Alpha Ophiuchi mini 128k v0.1 Q4 0
Alpha · NikolayKozloff
Params3.82B
Context128K
Smallest2.2 GB
GGUF
DO
DolphinStar 12.5B Q6 K
Dolphinstar · NikolayKozloff
Params12.5B
Context32K
Smallest10.2 GB
GGUF
LL
Llama-3-8B-dutch
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
QW
Qwen2-1.5B-ITA-Instruct
Qwen · NikolayKozloff
Params1.54B
Context32K
Smallest1.6 GB
GGUF
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest7.9 GB
CodingReasoningTool use
SA
SambaLingo-Slovenian-Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing