GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest6.3 GB
GR
Granite 3.2 8b Instruct Preview
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
LL
Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MI
Mixtral AI CyberTron Swahili 7b
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
NP
NPR 4B Q8 0
Npr · NikolayKozloff
Params4.02B
Context256K
Smallest4.3 GB
AL
ALMA 13B
Alma · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
OP
OpenELM 3B Instruct
Openelm · NikolayKozloff
Params3.04B
Context2K
Smallest3.2 GB
DU
Duet Minitron8b v0.5 Q8 0
Duet · NikolayKozloff
Params8.41B
Context8K
Smallest8.9 GB
OM
OmniLing V1 8b experimental Q8 0
Omniling · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · NikolayKozloff
Params8.41B
Context8K
Smallest8.9 GB
LL
Llama 3.1 Hawkish 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
OL
AMD OLMo 1B SFT
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
LL
Llasa 1B
Llasa · NikolayKozloff
Params1.37B
Context128K
Smallest1.5 GB
EX
EXAONE Deep 2.4B
Exaone · NikolayKozloff
Params2.41B
Context32K
Smallest2.6 GB
GE
Gemma 3 4b It Shqip v3
Gemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
NE
OpenReasoning Nemotron 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
OM
OmegLLaMA 3B
Omegllama · NikolayKozloff
Params3.43B
Context—
Smallest2.1 GB
MI
Mixtral AI SwahiliTron 7b
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
NE
neo 7b Q8 0
Neo · NikolayKozloff
Params7.79B
Context8K
Smallest8.3 GB
AL
Alphacode-MALI-9B
Alphacode · NikolayKozloff
Params8.99B
Context32K
Smallest9.6 GB
PH
Phi 3 medium 4k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest8.0 GB
LL
Ko-Llama-3-8B-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama-3-neoAI-8B-Chat-v0.1
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
QW
Einstein-v7-Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
GH
Ghost 8b Beta 1608
Ghost · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
MI
Mistral Nemo Kurdish Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Q4_K_M7.9 GB
BA
Bahasa-4b
Bahasa · NikolayKozloff
Params3.95B
Context32K
Smallest4.2 GB
LL
Llama-3-8b-ita-ties
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest4.8 GB