GGUF models by NikolayKozloff
1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.
QW
Replete LLM V2.5 Qwen 32b
Qwen · NikolayKozloff
Params32.8B
Context32K
Q4_K_M19.9 GB
MK
MKLLM-7B-Instruct
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
PO
Polaris 7B Preview
Polaris · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
OC
occiglot 7b it en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest9.1 GB
BI
Bitnet_B1_58 3B
Bitnet · NikolayKozloff
Params3.32B
Context2K
Smallest3.5 GB
LL
Llama eus 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
SA
saiga nemo 12b Q6 K
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
SA
tyr Q8 0
Saul · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
LL
suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest6.0 GB
VI
Viking SlimSonnet v0.2 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
CH
ChatFrame Q8 0
Chatframe · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
QW
FuseChat Qwen 2.5 7B Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
AL
AlphaMaze v0.2 1.5B
Alphamaze · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
KO
kona2 12B Q5 K M
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest8.9 GB
PH
Phi 3 medium 4k instruct Q5 0
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.6 GB
LL
Llama-3-8B-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GE
GeM2-Llamion-14B-Chat
Gem · NikolayKozloff
Params14.5B
Context4K
Smallest10.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · NikolayKozloff
Params8.83B
Context16K
Smallest9.4 GB
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
MI
SauerkrautLM 7b v1 mistral
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest4.6 GB
PI
Piaget 4B
Piaget · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
MG
mGPT-1.3B-tajik
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Q4_K_M8.6 GB
CE
L3.1 8B Celeste V1.5 Q8 0
Celeste · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
LL
uzbek llama 3.1 8B instruct v2 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
TO
tora 13b v1.0
Tora · NikolayKozloff
Params13B
Context4K
Smallest8.2 GB