GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
LA
latxa 7b v1.1
Latxa · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
TW
tweety 7b italian
Tweety · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Master-Yi-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest5.0 GB
LL
Llama-3-11.5B-Instruct-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest8.0 GB
LL
Llama-3-Oasis-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
LL
Tesser-Llama-3-Ko-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
SO
Solar-Ko-Recovery-11B
Solar · NikolayKozloff
Params11B
Context4K
Smallest9.0 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
DE
DeepSeek R1 ReDistill Llama3 8B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
HO
Homunculus
Homunculus · NikolayKozloff
Params12.5B
Context128K
Smallest10.2 GB
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
SA
SambaLingo Turkish Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
AY
aya-23-8B
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest4.8 GB
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest8.5 GB
EU
EuroLLM 1.7B Instruct Q8 0
Eurollm · NikolayKozloff
Params1.66B
Context8K
Smallest1.8 GB
BO
Boreas 7B Q8 0
Boreas · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
PH
Phi-3-Large-5.6b
Phi · NikolayKozloff
Params5.63B
Context4K
Smallest6.0 GB
GE
SauerkrautLM-Gemma-2b
Gemma · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
LL
NorskGPT Llama 13B v0.1
Llama · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
AL
Alphacode-MALI-11B
Alphacode · NikolayKozloff
Params8.99B
Context32K
Smallest9.6 GB
QW
QwQ 0.5B Distilled SFT
Qwen · NikolayKozloff
Params494M
Context32K
Smallest0.5 GB
KY
Kyro n1 14B Q5 K S
Kyro · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
OC
occiglot 7b es en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
LL
NorskGPT Llama 7B v0.1
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
QW
UIGEN T1.1 Qwen 14B Q4 K M
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB