GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi3 128k 6b Q8 0
Phi · NikolayKozloff
Params5.86B
Context128K
Smallest6.2 GB
GGUF
OM
OmniLing V1 12b experimental Q5 K M
Omniling · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
Tool use
MA
MagpieLM 8B Chat v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
GGUF
VI
Virtuoso Small v2
Virtuoso · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
CodingReasoning
QW
Ko-Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
GGUF
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest8.8 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest14.9 GB
Coding
GE
FuseChat Gemma 2 9B Instruct
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
HY
HyGPT 10b It
Hygpt · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
QW
Sailor-7B
Qwen · NikolayKozloff
Params7.72B
Context32K
Smallest8.2 GB
GGUF
LL
Llama 3.1 8B Instuct Uz Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
NE
Nemotron Cascade 8B Thinking
Nemotron · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
HE
Hermes 2 Pro French
Hermes · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
Tool use
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest9.6 GB
GGUF
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
ReasoningTool use
LL
Llama-3-11.5B-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest8.0 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Q4_K_M4.6 GB
Coding
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest9.0 GB
GGUF
MU
Muyan TTS SFT
Muyan · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
GGUF
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest8.8 GB
GGUF
LL
dolphin-2.9-llama3-8b-flashback
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
VI
Virtuoso Lite
Virtuoso · NikolayKozloff
Params10.3B
Context32K
Smallest11.0 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · NikolayKozloff
Params23.6B
Context32K
Smallest10.4 GB
GGUF
PE
Pensez v0.1 e5 Q8 0
Pensez · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
Tool use
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest4.7 GB
Coding

Keep browsing