GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM4.1 8B
MiniCPM · NikolayKozloff
Params8.19B
Context64K
Smallest5.8 GB
Reasoning
FA
Falcon
Falcon · NikolayKozloff
Params4.94B
Context2K
Smallest5.2 GB
GGUF
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest10.9 GB
GGUF
BG
MATH BG v1 7B
Bggpt · NikolayKozloff
Params7.29B
Context32K
Smallest7.7 GB
GGUF
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingVision
WI
WizardLM-2-7B-abliterated
Wizardlm · NikolayKozloff
Params7.24B
Context32K
Smallest5.0 GB
GGUF
EU
EuroLLM 9B Instruct
Eurollm · NikolayKozloff
Params9.15B
Context4K
Smallest9.7 GB
GGUF
PI
pip-code-bandit
Pip · NikolayKozloff
Params1.35B
Context16K
Smallest1.4 GB
Coding
SE
SeaPhi3 mini Q8 0
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
QW
HEFT Qwen
Qwen · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
Tool use
MG
mGPT-1.3B-chuvash
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
QW
Qwen2-7B-Instruct-deccp
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
GGUF
SA
saiga nemo 12b Q5 K M
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
OC
occiglot 7b de en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
DE
Delexa V0.1 7b
Delexa · NikolayKozloff
Params7.24B
Context128K
Smallest7.7 GB
GGUF
LI
0x lite Q4 K S
Lite · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
Tool use
KO
kona2 12B Q6 K
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest10.2 GB
GGUF
WO
WoonaV1.2 9b Q8 0
Woonav · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.4 GB
GGUF
QW
Qwen3 15B A2B Base
Qwen · NikolayKozloff
Params15.6B
Context4K
Smallest11.1 GB
Tool use
DA
h2o-danube3-500m-base
Danube · NikolayKozloff
Params514M
Context8K
Smallest0.5 GB
GGUF
MI
mathstral-7B-v0.1
Mistral · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
GGUF
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
CodingReasoning
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest5.0 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
Tool use
QW
Qwen3 16B A3B
Qwen · NikolayKozloff
Params16B
Context40K
Smallest11.1 GB
ReasoningTool use
HY
HY MT1.5 7B
NikolayKozloff
Params7.5B
Context256K
Smallest8.0 GB
GGUF
MI
mistral orthogonalized Q8 0
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF

Keep browsing