GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
MG
mGPT-1.3B-kalmyk
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · NikolayKozloff
Params7.25B
Context64K
Smallest6.4 GB
PH
Phi 3 medium 128k instruct Q5 0
Phi · NikolayKozloff
Params14B
Context128K
Smallest9.6 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
LL
Awanllm-Llama-3-8B-Cumulus-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
BE
bella-1-8b
Bella · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest9.8 GB
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest10.4 GB
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest8.0 GB
QW
UIGEN T1.1 Qwen 14B Q5 K S
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
HE
Helium 1 2b Science
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
US
UserLM 8b
Userlm · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
NorskGPT-Llama3-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
MI
Mistral Nemo Kurdish Instruct Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest16.0 GB
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest7.0 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
AR
Art v0 3B Q8 0
Art · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
RE
Replete-Coder-Instruct-8b-Merged
Replete · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
AL
ALMA 7B
Alma · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.4 GB
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
CH
L3-8B-Chara-v1-Alpha
Chara · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest8.1 GB
VI
Vikhr Nemo 12B Instruct R 21 09 24 Q5 K S
Vikhr · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB