GGUF models by prithivMLmods

599 GGUF models quantized by prithivMLmods on Hugging Face. Sizes run from 135M to 180B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Light IF 4B f32
Light · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
GC
GCIRS Reasoning 1.5B R1
Gcirs · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
DE
DeepSeek V4 Pro Qwen3.5 9B NVFP4 GPTQ
DeepSeek · prithivMLmods
Params9.2B
Context256K
Smallest8.5 GB
ReasoningTool useVision
OP
OpenRHO 2B Thinker
Openrho · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Spiral Qwen3 4B F32
Qwen · prithivMLmods
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
Polaris VGA 4B Post1.0e
Qwen · prithivMLmods
Params4.21B
Context256K
Smallest4.5 GB
ReasoningTool useVision
LL
Llama Chat Summary 3.2 3B
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SM
SmolLM2 CoT 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
QW
Qwen3 4B ShiningValiant3
Qwen · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
AP
Nous 1 4B f32
Apollo · prithivMLmods
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepCaption VLA 7B
Deepcaption · prithivMLmods
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
QwQ LCoT 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LI
LightOnOCR 2 1B
Lightonocr · prithivMLmods
Params596M
Context16K
Smallest0.6 GB
Vision
MA
Math IIO 7B Instruct
Math · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SM
SmolLM2 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
PI
Piaget 4B
Piaget · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek R1 Llama 8B F32
DeepSeek · prithivMLmods
Params8B
Context—
Smallest15.6 GB
Reasoning
GR
Granite Docling 258M
Granite · prithivMLmods
Params164M
Context8K
Smallest0.2 GB
Vision
UI
UIGEN T3 4B Preview
Uigen · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
JA
Jan nano F32
Jan · prithivMLmods
Params4.02B
Context40K
Smallest8.1 GB
GGUF
SI
SimpleChat 4B V1 f32
Simplechat · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
LL
cogito v1 preview llama 3B f32
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
QW
Qwen3.6 27B Abliterated rMAX
Qwen · prithivMLmods
Params26.9B
Context256K
Smallest28.6 GB
ReasoningTool useVision
DE
Delorme_1 OCR 7B Post1.0
Delorme · prithivMLmods
Params7.62B
Context125K
Smallest8.1 GB
Vision
NU
NuMarkdown-8B-Thinking
Numarkdown · prithivMLmods
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
SF
SFT 4B ScaleCUA EvoCUA
Sft · prithivMLmods
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
EX
Explora 0.6B
Explora · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
QW
Procyon 1.5B Theorem
Qwen · prithivMLmods
Params1.78B
Context16K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 Rethink 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
LU
Luth Instruct
Luth · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use

Keep browsing