GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MG
mGPT-1.3B-kalmyk
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · NikolayKozloff
Params7.25B
Context64K
Smallest6.4 GB
Coding
PH
Phi 3 medium 128k instruct Q5 0
Phi · NikolayKozloff
Params14B
Context128K
Smallest9.6 GB
Coding
LL
Llama-3-Instruct-8B-SimPO
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Awanllm-Llama-3-8B-Cumulus-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
BE
bella-1-8b
Bella · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
llama3-tweety-8b-italian
Llama · NikolayKozloff
Params7.24B
Context8K
Smallest7.7 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
Coding
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest9.8 GB
GGUF
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest10.4 GB
GGUF
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest8.0 GB
GGUF
QW
UIGEN T1.1 Qwen 14B Q5 K S
Qwen · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
CodingReasoningTool use
HE
Helium 1 2b Science
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
GGUF
US
UserLM 8b
Userlm · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
NorskGPT-Llama3-8b
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MI
Mistral Nemo Kurdish Instruct Q5 K M
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
Tool use
CO
Confucius O1 14B
Confucius · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
Tool use
GE
Amoral Gemma3 12B
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.2 GB
Roleplay
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest16.0 GB
GGUF
OR
Orcapaca_Albanian
Orcapaca · NikolayKozloff
Params9.78B
Context8K
Smallest7.0 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
AR
Art v0 3B Q8 0
Art · NikolayKozloff
Params3.09B
Context32K
Smallest3.3 GB
GGUF
RE
Replete-Coder-Instruct-8b-Merged
Replete · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
Coding
AL
ALMA 7B
Alma · NikolayKozloff
Params6.74B
Context4K
Smallest5.5 GB
GGUF
LL
Llama-3SOME-8B-v2
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest4.4 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
Coding
CH
L3-8B-Chara-v1-Alpha
Chara · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Smallest8.1 GB
Coding
VI
Vikhr Nemo 12B Instruct R 21 09 24 Q5 K S
Vikhr · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
GGUF

Keep browsing