GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.1 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest6.3 GB
GGUF
BE
bella-2-8b
Bella · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OL
AMD OLMo 1B
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
GGUF
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest12.1 GB
Tool use
MI
MegaBeam Mistral 7B 300k Q8 0
Mistral · NikolayKozloff
Params7.24B
Context282K
Smallest7.7 GB
GGUF
LL
Llama-2-7b-gsm8k
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
GGUF
MI
mistral doryV2 12b Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
MI
Mistral Nemo Kurdish Q5 K S
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
GGUF
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest8.9 GB
GGUF
PO
poemma 12B Q6 K
Poemma · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
Tool use
CU
Art 0 8B
Customthinker · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
GGUF
HO
Homunculus
Homunculus · NikolayKozloff
Params12.5B
Context128K
Smallest8.9 GB
ReasoningTool use
SK
Skywork OR1 7B
Skywork · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
Tool use
PH
Phi 3 medium 128k instruct Q4 0
Phi · NikolayKozloff
Params14B
Context128K
Smallest7.9 GB
Coding
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
PY
Pydevmini1
Pydevmini · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
Reasoning
MI
mistral doryV2 12b Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
MI
2 mini Q4 K S
Mini · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
ReasoningTool use
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
GGUF
LL
SFR-SFT-LLaMA-3-8B-R
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Llama-3-11.5B-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest6.6 GB
GGUF
GE
GeM2-Llamion-14B-Chat
Gem · NikolayKozloff
Params14.5B
Context4K
Smallest10.0 GB
GGUF
SE
SeaPhi3 mini Q5 K M
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest2.8 GB
GGUF
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest9.7 GB
Coding
GR
GreekLlama-1.1B-it
Greekllama · NikolayKozloff
Params1.1B
Context2K
Smallest1.2 GB
GGUF
GR
GreekLlama-1.1B-base
Greekllama · NikolayKozloff
Params1.1B
Context2K
Smallest1.2 GB
GGUF

Keep browsing