GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi3 ITA mini 4K instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
LL
Llama 3.2 1B
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
GGUF
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.6 GB
GGUF
KO
kona2 12B Q4 K M
Kona · NikolayKozloff
Params12.5B
Context1000K
Q4_K_M7.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
Coding
LL
suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest7.9 GB
GGUF
LL
Llama-3-portuguese-Tom-cat-8b-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest5.3 GB
Coding
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
CodingTool use
MA
MagpieLM 4B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
GGUF
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
GGUF
LL
Vikhr-Llama-3.2-1B-instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Smallest9.1 GB
Coding
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
Tool use
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Q4_K_M9.0 GB
CodingReasoningTool use
LA
latxa-7b-v1.2
Latxa · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.4 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
RE
ReasonableQwen3 4B
Reasonableqwen · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
GGUF
KA
Kakugo 3B Fao
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest5.3 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest8.8 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
MI
Mistral 7B v0.1 capybara orpo en de
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
CH
Chocolatine-8B-Instruct-DPO-v1.0
Chocolatine · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GP
Gpt Oss 20b Uncensored Bf16
gpt-oss · NikolayKozloff
Params20.9B
Context128K
Smallest12.1 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest6.1 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF

Keep browsing