GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Replete LLM V2.5 Qwen 32b
Qwen · NikolayKozloff
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MK
MKLLM-7B-Instruct
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
PO
Polaris 7B Preview
Polaris · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
OC
occiglot 7b it en
Occiglot · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · NikolayKozloff
Params8.03B
Context8K
Smallest5.6 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest9.1 GB
GGUF
BI
Bitnet_B1_58 3B
Bitnet · NikolayKozloff
Params3.32B
Context2K
Smallest3.5 GB
GGUF
LL
Llama eus 8B Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SA
saiga nemo 12b Q6 K
Saiga · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
SA
tyr Q8 0
Saul · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest5.7 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest6.0 GB
GGUF
VI
Viking SlimSonnet v0.2 7B Q8 0
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest8.0 GB
GGUF
CH
ChatFrame Q8 0
Chatframe · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
QW
FuseChat Qwen 2.5 7B Instruct
Qwen · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
AL
AlphaMaze v0.2 1.5B
Alphamaze · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
KO
kona2 12B Q5 K M
Kona · NikolayKozloff
Params12.5B
Context1000K
Smallest8.9 GB
GGUF
PH
Phi 3 medium 4k instruct Q5 0
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.6 GB
Coding
LL
Llama-3-8B-instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
Tool use
LL
Llama-3-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GE
GeM2-Llamion-14B-Chat
Gem · NikolayKozloff
Params14.5B
Context4K
Smallest10.3 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · NikolayKozloff
Params8.83B
Context16K
Smallest9.4 GB
GGUF
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MI
SauerkrautLM 7b v1 mistral
Mistral · NikolayKozloff
Params7.24B
Context32K
Smallest4.6 GB
GGUF
PI
Piaget 4B
Piaget · NikolayKozloff
Params4.02B
Context40K
Smallest4.3 GB
Reasoning
MG
mGPT-1.3B-tajik
Mgpt · NikolayKozloff
Params1.83B
Context2K
Smallest2.0 GB
GGUF
VI
Viking-13B
Viking · NikolayKozloff
Params14B
Context4K
Q4_K_M8.6 GB
Coding
CE
L3.1 8B Celeste V1.5 Q8 0
Celeste · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
uzbek llama 3.1 8B instruct v2 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
GGUF
TO
tora 13b v1.0
Tora · NikolayKozloff
Params13B
Context4K
Smallest8.2 GB
GGUF

Keep browsing