GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest5.8 GB
FA
Falcon
Falcon · NikolayKozloff
Params4.94B
Context2K
Smallest5.2 GB
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest10.9 GB
BG
MATH BG v1 7B
Bggpt · NikolayKozloff
Params7.29B
Context32K
Smallest7.7 GB
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
EU
EuroLLM 9B Instruct
Eurollm · NikolayKozloff
Params9.15B
Context4K
Smallest9.7 GB
PI
pip-code-bandit
Pip · NikolayKozloff
Params1.35B
Context16K
Smallest1.4 GB
SE
SeaPhi3 mini Q8 0
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
QW
HEFT Qwen
Qwen · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
MG
mGPT-1.3B-chuvash
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
QW
Qwen2-7B-Instruct-deccp
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
SA
saiga nemo 12b Q5 K M
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
OC
occiglot 7b de en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
DE
Delexa V0.1 7b
Delexa · NikolayKozloff
Params7.24B
Context128K
Smallest7.7 GB
LI
0x lite Q4 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
KO
kona2 12B Q6 K
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest10.2 GB
WO
WoonaV1.2 9b Q8 0
Woonav · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.4 GB
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest11.1 GB
DA
h2o-danube3-500m-base
Danube · NikolayKozloff
Params514M
Context8K
Smallest0.5 GB
MI
mathstral-7B-v0.1
Mistral · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Q4_K_M8.4 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest5.0 GB
GR
Granite 3.1 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
QW
Qwen3 16B A3B
Qwen · NikolayKozloff
Params16B
Context40K
Smallest11.1 GB
HY
HY MT1.5 7B
NikolayKozloff
Params7.5B
Context256K
Smallest8.0 GB
MI
mistral orthogonalized Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB