GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
latxa 7b v1.1
Latxa · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
TW
tweety 7b italian
Tweety · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Master-Yi-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest5.0 GB
GGUF
LL
Llama-3-11.5B-Instruct-V2
Llama · NikolayKozloff
Params11.5B
Context8K
Smallest8.0 GB
GGUF
LL
Llama-3-Oasis-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Tesser-Llama-3-Ko-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
SO
Solar-Ko-Recovery-11B
Solar · NikolayKozloff
Params11B
Context4K
Smallest9.0 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
DE
DeepSeek R1 ReDistill Llama3 8B v1.1 Q8 0
DeepSeek · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
HO
Homunculus
Homunculus · NikolayKozloff
Params12.5B
Context128K
Smallest10.2 GB
ReasoningTool use
AR
ArmenianGPT 0.1 12B
Armeniangpt · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Reasoning
SA
SambaLingo Turkish Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
GGUF
AY
aya-23-8B
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest4.8 GB
GGUF
LL
LLAMA-3_8B_Unaligned_Alpha
Llama · NikolayKozloff
Params8.03B
Context10K
Smallest8.5 GB
GGUF
EU
EuroLLM 1.7B Instruct Q8 0
Eurollm · NikolayKozloff
Params1.66B
Context8K
Smallest1.8 GB
GGUF
BO
Boreas 7B Q8 0
Boreas · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
PH
Phi-3-Large-5.6b
Phi · NikolayKozloff
Params5.63B
Context4K
Smallest6.0 GB
GGUF
GE
SauerkrautLM-Gemma-2b
Gemma · NikolayKozloff
Params2.51B
Context8K
Smallest2.7 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · NikolayKozloff
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
NorskGPT Llama 13B v0.1
Llama · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB
GGUF
AL
Alphacode-MALI-11B
Alphacode · NikolayKozloff
Params8.99B
Context32K
Smallest9.6 GB
GGUF
QW
QwQ 0.5B Distilled SFT
Qwen · NikolayKozloff
Params494M
Context32K
Smallest0.5 GB
ReasoningTool use
KY
Kyro n1 14B Q5 K S
Kyro · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Reasoning
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OC
occiglot 7b es en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
NorskGPT Llama 7B v0.1
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
QW
UIGEN T1.1 Qwen 14B Q4 K M
Qwen · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use

Keep browsing