GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
HE
Hermes 4 14B
Hermes · NikolayKozloff
Params14.8B
Context40K
Smallest8.6 GB
ReasoningRoleplayTool use
WI
Wiedervereinigung-7b-dpo-laser
Wiedervereinigung · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
NE
NextCoder 14B Q5 K S
Nextcoder · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
AL
Alpha-Orionis-v0.1
Alpha · NikolayKozloff
Params7.24B
Context32K
Smallest4.1 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.4 GB
GGUF
OL
OlympicCoder 7B Q8 0
Olympiccoder · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
CodingReasoningTool use
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
CO
Confucius3 Math
Confucius · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
Tool use
HU
Hunyuan 4B Instruct
Hunyuan · NikolayKozloff
Params4.22B
Context256K
Smallest4.5 GB
ReasoningTool use
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OR
Orbita-v0.1
Orbita · NikolayKozloff
Params14.2B
Context32K
Smallest10.5 GB
GGUF
LL
Llama-2-7b-cnn-daily-mail
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest4.4 GB
Coding
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest10.4 GB
Coding
OL
AMD OLMo 1B SFT DPO
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
TE
Teuken 7B Instruct Research v0.4
Teuken · NikolayKozloff
Params7.45B
Context4K
Smallest7.9 GB
GGUF
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Tool use
VI
Virtuoso Lite
Virtuoso · NikolayKozloff
Params10.3B
Context32K
Smallest8.5 GB
Tool use
DN
DNA R1 Q4 K M
Dna · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
LI
Light R1 14B DS
Light · NikolayKozloff
Params14.8B
Context128K
Smallest10.5 GB
ReasoningTool use
EX
EXAONE Deep 7.8B
Exaone · NikolayKozloff
Params7.82B
Context32K
Smallest8.3 GB
GGUF
FI
Fin R1 Q8 0
Fin · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
ReasoningTool use
LL
llama3_8b_chat_brainstorm
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest6.6 GB
GGUF
ME
Meraj Mini Q8 0
Meraj · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest8.3 GB
Coding
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest5.4 GB
Coding
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoning
SA
SambaLingo Bulgarian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
GGUF

Keep browsing