GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
WI
Wiedervereinigung-7b-dpo-laser
Wiedervereinigung · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
NE
NextCoder 14B Q5 K S
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.4 GB
OL
OlympicCoder 7B Q8 0
Olympiccoder · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
HU
Hunyuan 4B Instruct
Hunyuan · NikolayKozloff
Params4.22B
Context256K
Smallest4.5 GB
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
OR
Orbita-v0.1
Orbita · NikolayKozloff
Params14.2B
Context32K
Smallest10.5 GB
LL
Llama-2-7b-cnn-daily-mail
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest4.4 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest10.4 GB
OL
AMD OLMo 1B SFT DPO
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
TE
Teuken 7B Instruct Research v0.4
Teuken · NikolayKozloff
Params7.45B
Context4K
Smallest7.9 GB
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
VI
Virtuoso Lite
Virtuoso · NikolayKozloff
Params10.3B
Context32K
Smallest8.5 GB
DN
DNA R1 Q4 K M
Dna · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
LI
Light R1 14B DS
Light · NikolayKozloff
Params14.8B
Context128K
Smallest10.5 GB
EX
EXAONE Deep 7.8B
Exaone · NikolayKozloff
Params7.82B
Context32K
Smallest8.3 GB
FI
Fin R1 Q8 0
Fin · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
LL
llama3_8b_chat_brainstorm
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
ME
Meraj Mini Q8 0
Meraj · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest8.3 GB
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest5.4 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
SA
SambaLingo Bulgarian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB