GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
EU
EuroLLM 1.7B
Eurollm · NikolayKozloff
Params1.66B
Context4K
Smallest1.8 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest8.5 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · NikolayKozloff
Params3.43B
Context256K
Smallest3.7 GB
NA
Nanbeige4 3B Thinking 2511
Nanbeige · NikolayKozloff
Params3.93B
Context64K
Smallest4.2 GB
MG
mGPT-1.3B-ossetian
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
YU
YuE s2 1B general Q8 0
Yue · NikolayKozloff
Params1.96B
Context8K
Smallest2.1 GB
MI
MegaBeam Mistral 7B 512k
Mistral · NikolayKozloff
Params7.24B
Context512K
Smallest7.7 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
GR
Granite 4.0 H 350m
Granite · NikolayKozloff
Params340M
Context1024K
Smallest0.4 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · NikolayKozloff
Params27.2B
Context8K
Smallest10.4 GB
VI
Virtuoso Small v2
Virtuoso · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
KA
Kakugo 3B Cym
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
KA
Kakugo 3B Gla
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
CH
ChatFrame Instruct Persian Small Q8 0
Chatframe · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
FA
FastApply 7B v1.0 Q6 K
Fastapply · NikolayKozloff
Params7.62B
Context32K
Smallest6.3 GB
AY
Aya Expanse 8b
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
SM
SmolLM2 360M Instruct Q8 0
SmolLM · NikolayKozloff
Params362M
Context8K
Smallest0.4 GB
LI
Light R1 14B DS
Light · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · NikolayKozloff
Params21.8B
Context128K
Smallest9.5 GB
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Q4_K_M4.7 GB
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
OP
OpenCoder 8B Instruct
Opencoder · NikolayKozloff
Params7.77B
Context8K
Smallest6.4 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest8.6 GB
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest5.7 GB