GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest6.3 GB
GGUF
GR
Granite 3.2 8b Instruct Preview
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
Tool use
LL
Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Mixtral AI CyberTron Swahili 7b
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
NP
NPR 4B Q8 0
Npr · NikolayKozloff
Params4.02B
Context256K
Smallest4.3 GB
GGUF
AL
ALMA 13B
Alma · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
OP
OpenELM 3B Instruct
Openelm · NikolayKozloff
Params3.04B
Context2K
Smallest3.2 GB
GGUF
DU
Duet Minitron8b v0.5 Q8 0
Duet · NikolayKozloff
Params8.41B
Context8K
Smallest8.9 GB
GGUF
OM
OmniLing V1 8b experimental Q8 0
Omniling · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · NikolayKozloff
Params8.41B
Context8K
Smallest8.9 GB
GGUF
LL
Llama 3.1 Hawkish 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
OL
AMD OLMo 1B SFT
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
LL
Llasa 1B
Llasa · NikolayKozloff
Params1.37B
Context128K
Smallest1.5 GB
Tool use
EX
EXAONE Deep 2.4B
Exaone · NikolayKozloff
Params2.41B
Context32K
Smallest2.6 GB
GGUF
GE
Gemma 3 4b It Shqip v3
Gemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
CodingReasoning
OM
OmegLLaMA 3B
Omegllama · NikolayKozloff
Params3.43B
Context—
Smallest2.1 GB
GGUF
MI
Mixtral AI SwahiliTron 7b
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
NE
neo 7b Q8 0
Neo · NikolayKozloff
Params7.79B
Context8K
Smallest8.3 GB
GGUF
AL
Alphacode-MALI-9B
Alphacode · NikolayKozloff
Params8.99B
Context32K
Smallest9.6 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest8.0 GB
Coding
LL
Ko-Llama-3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
QW
Einstein-v7-Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
Tool use
MI
Mistral Nemo Kurdish Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
Tool use
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
BA
Bahasa-4b
Bahasa · NikolayKozloff
Params3.95B
Context32K
Smallest4.2 GB
GGUF
LL
Llama-3-8b-ita-ties
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest4.8 GB
GGUF

Keep browsing