GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
PH
Phi 3 medium 128k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context128K
Smallest8.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest10.1 GB
AE
L3-Aethora-15B
Aethora · NikolayKozloff
Params15B
Context8K
Smallest8.6 GB
LL
cendol-llama2-7b-chat
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
LF
LFM2 2.6B
Lfm · NikolayKozloff
Params2.57B
Context125K
Smallest2.7 GB
MI
Minerva 1B base v1.0 Q6 K
Minerva · NikolayKozloff
Params1.01B
Context16K
Smallest0.8 GB
ST
Stable DiffCoder 8B Base
Stable · NikolayKozloff
Params8.25B
Context8K
Smallest8.8 GB
UW
UwU 7B Instruct Q8 0
Uwu · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
IR
Irbis-7b-v0.1
Irbis · NikolayKozloff
Params7.47B
Context32K
Smallest7.9 GB
MI
Mistral 7B Instruct Uz
Mistral · NikolayKozloff
Params7.25B
Context32K
Smallest7.7 GB
GR
granite-8b-code-instruct
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest6.6 GB
NE
NextCoder 7B
Nextcoder · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
MA
MAmmoTH Coder 7B
Mammoth · NikolayKozloff
Params6.74B
Context16K
Smallest5.5 GB
EU
EuroLLM 9B
Eurollm · NikolayKozloff
Params9.15B
Context4K
Smallest9.7 GB
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Smallest8.3 GB
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest7.3 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
QW
Qwen2-7B
Qwen · NikolayKozloff
Params7.62B
Context128K
Smallest4.5 GB
LI
Ling Coder Lite
Ling · NikolayKozloff
Params16.8B
Context4K
Smallest10.2 GB
QW
Qwen-portuguese-luana-7b
Qwen · NikolayKozloff
Params7.72B
Context32K
Smallest8.2 GB
LL
h2o-Llama-3-8B-Japanese-Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · NikolayKozloff
Params2.61B
Context8K
Smallest2.8 GB
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest9.9 GB
LL
llama 7b finnish v2 Q8 0
Llama · NikolayKozloff
Params7B
Context2K
Smallest7.4 GB
LL
Llama-2-7b-dolphin-open_platypus
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · NikolayKozloff
Params13.5B
Context256K
Smallest9.4 GB
SA
SambaLingo Hungarian Chat
Sambalingo · NikolayKozloff
Params6.95B
Context4K
Smallest7.4 GB
LF
LFM2 8B A1B
Lfm · NikolayKozloff
Params8.34B
Context125K
Smallest8.9 GB
LA
latxa-13b-v1.2
Latxa · NikolayKozloff
Params13B
Context4K
Smallest10.7 GB