GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
PH
Phi3 ITA mini 4K instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
LL
Llama 3.2 1B
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.6 GB
KO
kona2 12B Q4 K M
Kona · NikolayKozloff
Params12.5B
Context1000K
Q4_K_M7.6 GB
PH
Phi 3.5 Mini Instruct
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
LL
suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
BI
Bielik 11B v2.3 Instruct
Bielik · NikolayKozloff
Params11.2B
Context32K
Smallest7.9 GB
LL
Llama-3-portuguese-Tom-cat-8b-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest5.3 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
MA
MagpieLM 4B SFT v0.1 Q8 0
Magpielm · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest5.3 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · NikolayKozloff
Params1.24B
Context128K
Smallest1.3 GB
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Smallest9.1 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · NikolayKozloff
Params4.51B
Context128K
Smallest4.8 GB
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Q4_K_M9.0 GB
LA
latxa-7b-v1.2
Latxa · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GI
GigaChat3 10B A1.8B Bf16
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest7.4 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
RE
ReasonableQwen3 4B
Reasonableqwen · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
KA
Kakugo 3B Fao
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
QW
Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest5.3 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest8.8 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
MI
Mistral 7B v0.1 capybara orpo en de
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
CH
Chocolatine-8B-Instruct-DPO-v1.0
Chocolatine · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GP
Gpt Oss 20b Uncensored Bf16
gpt-oss · NikolayKozloff
Params20.9B
Context128K
Smallest12.1 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · NikolayKozloff
Params10.7B
Context16K
Smallest6.1 GB
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Q4_K_M3.7 GB