GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
PH
phi3 128k 6b Q8 0
Phi · NikolayKozloff
Params5.86B
Context128K
Smallest6.2 GB
OM
OmniLing V1 12b experimental Q5 K M
Omniling · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
MA
MagpieLM 8B Chat v0.1 Q8 0
Magpielm · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
VI
Virtuoso Small v2
Virtuoso · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
QW
Ko-Qwen2-7B-Instruct
Qwen · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
LL
Turkish-Llama-8b-Instruct-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest8.8 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest14.9 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
HY
HyGPT 10b It
Hygpt · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
QW
Sailor-7B
Qwen · NikolayKozloff
Params7.72B
Context32K
Smallest8.2 GB
LL
Llama 3.1 8B Instuct Uz Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
NE
Nemotron Cascade 8B Thinking
Nemotron · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
HE
Hermes 2 Pro French
Hermes · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
MI
Mistral Small Instruct 2409
Mistral · NikolayKozloff
Params22.2B
Context128K
Smallest9.6 GB
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
DH
Dhanishtha 2.0 Preview
Dhanishtha · NikolayKozloff
Params14.8B
Context40K
Smallest10.3 GB
LL
Llama-3-11.5B-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest8.0 GB
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Q4_K_M4.6 GB
GI
GigaChat 20B A3B Instruct
Gigachat · NikolayKozloff
Params20.6B
Context128K
Smallest9.0 GB
MU
Muyan TTS SFT
Muyan · NikolayKozloff
Params3.61B
Context128K
Smallest3.8 GB
GI
GigaChat3 10B A1.8B
Gigachat · NikolayKozloff
Params10.7B
Context256K
Smallest8.8 GB
LL
dolphin-2.9-llama3-8b-flashback
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
VI
Virtuoso Lite
Virtuoso · NikolayKozloff
Params10.3B
Context32K
Smallest11.0 GB
MI
Mistral Small 24B Instruct 2501
Mistral · NikolayKozloff
Params23.6B
Context32K
Smallest10.4 GB
PE
Pensez v0.1 e5 Q8 0
Pensez · NikolayKozloff
Params7.61B
Context32K
Smallest8.1 GB
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest4.7 GB