GGUF models by NikolayKozloff

1011 GGUF models quantized by NikolayKozloff on Hugging Face. Sizes run from 30M to 33.1B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context8K
Smallest1.8 GB
GGUF
RO
RoLlama2-7b-Base
Rollama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
Coding
QW
Qwen2 Math 7B Instruct
Qwen · NikolayKozloff
Params7.62B
Context4K
Smallest8.1 GB
GGUF
GE
Amoral Gemma3 4B
Gemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
GGUF
MI
Mistral Nemo Kurdish Instruct Q5 K S
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
KA
Kakugo 3B Ltz
Kakugo · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
LL
Llama 3.3 8B Instruct
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest8.8 GB
GGUF
GL
GLM 4.6V Flash
GLM · NikolayKozloff
Params9.4B
Context128K
Smallest5.8 GB
Vision
NU
NuminaMath-7B-TIR
Numinamath · NikolayKozloff
Params6.91B
Context4K
Smallest4.0 GB
GGUF
NO
NousCoder 14B
Nouscoder · NikolayKozloff
Params14.8B
Context80K
Smallest8.6 GB
CodingReasoningTool use
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
ON
oneirogen-7B
Oneirogen · NikolayKozloff
Params7.62B
Context128K
Smallest4.4 GB
GGUF
VI
Viking-7B
Viking · NikolayKozloff
Params7.55B
Context4K
Smallest5.3 GB
Coding
MI
Mistral NeMo Minitron 8B Base
Mistral · NikolayKozloff
Params8.41B
Context8K
Smallest8.9 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest11.0 GB
Coding
LI
Light R1 14B DS
Light · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
RE
Reka Flash 3
Reka · NikolayKozloff
Params20.9B
Context32K
Smallest8.6 GB
GGUF
PI
Piaget 1.7B
Piaget · NikolayKozloff
Params1.72B
Context40K
Smallest1.8 GB
Reasoning
DE
DeepSeek Prover V2 7B
DeepSeek · NikolayKozloff
Params6.91B
Context64K
Smallest7.3 GB
Tool use
LL
Llama-2-7b-Ukrainian
Llama · NikolayKozloff
Params6.74B
Context4K
Smallest7.2 GB
GGUF
TA
tabula-8b
Tabula · NikolayKozloff
Params8.03B
Context8K
Smallest4.7 GB
GGUF
DE
DeepScaleR 1.5B Preview
Deepscaler · NikolayKozloff
Params1.78B
Context128K
Smallest1.9 GB
Tool use
YI
dao 9b Q8 0
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
GGUF
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · NikolayKozloff
Params1.78B
Context32K
Smallest1.9 GB
Tool use
OL
Olmo 3 7B Instruct
OLMo · NikolayKozloff
Params7.3B
Context64K
Smallest7.8 GB
GGUF
PH
phi 4 Q8 0
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest15.6 GB
Coding
TO
tora code 7b v1.0
Tora · NikolayKozloff
Params6.74B
Context16K
Smallest5.5 GB
Coding
MI
Mistral Small 24B Instruct 2501
Mistral · NikolayKozloff
Params23.6B
Context32K
Smallest8.9 GB
GGUF

Keep browsing