GGUF models by prithivMLmods

599 GGUF models quantized by prithivMLmods on Hugging Face. Sizes run from 135M to 180B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
D1
d1 3B
prithivMLmods
Params2.7B
Context32K
Q4_K_M1.7 GB
ReasoningTool useVision
ME
Mellum2.1 12B A2.5B Thinking
Mellum · prithivMLmods
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
IN
Intern Decision 4B
InternLM · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
FA
Fara 7B
Fara · prithivMLmods
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 Coder 1.5b Bnb 4bit
Qwen · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Logics SWE Qwen3.6 35B A3B
Qwen · prithivMLmods
Params34.7B
Context256K
Smallest18.1 GB
CodingReasoningTool use
OR
Ornith 1.5 122B NVFP4
Ornith · prithivMLmods
Params125B
Context256K
Smallest80.9 GB
ReasoningTool useVision
SA
Sage A1.5
Sage · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
CodingReasoningTool use
MI
MiniCPM V 4.6
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
ON
OneDecision VisionGuard 27B SFT
Onedecision · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27.3B
Context256K
Smallest10.9 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B
Qwen · prithivMLmods
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
CL
clef
Clef · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
LI
lift
Lift · prithivMLmods
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
SH
ShutterMuse
Shuttermuse · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
OL
Olmo 3 7B Instruct
OLMo · prithivMLmods
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
DY
DynaGuard AIO
Dynaguard · prithivMLmods
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
ZW
ZwZ2 4B
Zwz · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
GE
Gemma 4 E2B It Qat
Gemma · prithivMLmods
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
QW
Qwen2 VL OCR 2B Instruct
Qwen · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingVision
OV
OvisOCR3
Ovisocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
NU
NuExtract3
Nuextract · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
OP
OpenCaption 4B VL SFT v1.0
Opencaption · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
Vision
LF
LFM3 Omni 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
CA
Carbon X
Carbon · prithivMLmods
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GE
Gelato 30B A3B
Gelato · prithivMLmods
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool useVision
QW
Gliese Qwen3.5 0.8B Abliterated Caption
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
MI
MiniCPM V 4.6 Thinking Abliterated MAX
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Gemma 4 E4B It Qat Heretic_Decensored
Gemma · prithivMLmods
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision

Keep browsing