GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.1 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest6.3 GB
BE
bella-2-8b
Bella · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
OL
AMD OLMo 1B
OLMo · NikolayKozloff
Params1.18B
Context2K
Smallest1.3 GB
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest12.1 GB
MI
MegaBeam Mistral 7B 300k Q8 0
Mistral · NikolayKozloff
Params7.24B
Context282K
Smallest7.7 GB
LL
Llama-2-7b-gsm8k
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
MI
mistral doryV2 12b Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
MI
Mistral Nemo Kurdish Q5 K S
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
SI
Silly v0.2
Silly · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · NikolayKozloff
Params12.8B
Context128K
Smallest8.9 GB
PO
poemma 12B Q6 K
Poemma · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
CU
Art 0 8B
Customthinker · NikolayKozloff
Params8.19B
Context40K
Smallest8.7 GB
HO
Homunculus
Homunculus · NikolayKozloff
Params12.5B
Context128K
Smallest8.9 GB
SK
Skywork OR1 7B
Skywork · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
PH
Phi 3 medium 128k instruct Q4 0
Phi · NikolayKozloff
Params14B
Context128K
Smallest7.9 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
PY
Pydevmini1
Pydevmini · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
MI
mistral doryV2 12b Q6 K
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
MI
2 mini Q4 K S
Mini · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
LL
SFR-SFT-LLaMA-3-8B-R
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama-3-11.5B-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest6.6 GB
GE
GeM2-Llamion-14B-Chat
Gem · NikolayKozloff
Params14.5B
Context4K
Smallest10.0 GB
SE
SeaPhi3 mini Q5 K M
Seaphi · NikolayKozloff
Params3.82B
Context128K
Smallest2.8 GB
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest9.7 GB
GR
GreekLlama-1.1B-it
Greekllama · NikolayKozloff
Params1.1B
Context2K
Smallest1.2 GB
GR
GreekLlama-1.1B-base
Greekllama · NikolayKozloff
Params1.1B
Context2K
Smallest1.2 GB