GGUF models by webmp3

88 GGUF models quantized by webmp3 on Hugging Face. Sizes run from 135M to 748B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OM
Sakura d1 omni 600M HighQuality
Omni · webmp3
Params381M
Context125K
Smallest0.0 GB
GGUF
HO
Sakura K2 Horizon 0.9B
Horizon · webmp3
Params1.08B
Context128K
Smallest0.5 GB
ReasoningTool use
QW
Sakura Qwen Image 2.1 Turbo
Qwen · webmp3
Params7.12B
Context—
Q4_K_M4.1 GB
GGUF
GE
Sakura Gemma4 E4B EmbeddingGemma2 DualMode
Gemma · webmp3
Params7.52B
Context128K
Smallest5.8 GB
EmbeddingReasoningTool use
SE
Sakura SenseNova Loop 9B Preview
Sensenova · webmp3
Params8.96B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
JA
Jais-3-7B
Jais · webmp3
Params9B
Context512K
Q4_K_M5.6 GB
ReasoningTool use
QW
Sakura Qwen3.8 Flash Next Compact Gyro M 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest51.0 GB
ReasoningTool use
IR
Sakura Iris 3B
Iris · webmp3
Params2.99B
Context—
Q4_K_M3.4 GB
GGUF
LF
LFM3 1.7B
Lfm · webmp3
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · webmp3
Params177B
Context256K
Smallest57.2 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · webmp3
Params177B
Context256K
Smallest59.2 GB
ReasoningTool use
FA
Fara1.5 9B
Fara · webmp3
Params8.95B
Context256K
Smallest4.2 GB
Vision
QW
Sakura Humanlike Chat 2.0 AutoRound
Qwen · webmp3
Params27.3B
Context256K
Smallest13.5 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest206.9 GB
ReasoningTool use
SA
Sage-A1.5
Sage · webmp3
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ3 S 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest68.3 GB
ReasoningTool use
OV
OvisOCR3
Ovisocr · webmp3
Params752M
Context256K
Smallest0.4 GB
ReasoningTool useVision
DE
Sakura DeepSeek V4.1 Flash 1017 Maya XS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest199.8 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Compact ISTA Q2 0 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest2.6 GB
ReasoningTool use
TW
Sakura TwIL LM3 Pro
Twil · webmp3
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
MI
Sakura MiMo V2.6 Flash MOPD P160
Mimo · webmp3
Params195B
Context1024K
Smallest57.8 GB
ReasoningTool use
WE
WeVisCut
Weviscut · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
EM
embeddinggemma-2
Embeddinggemma · webmp3
Params271M
Context256K
Smallest0.2 GB
Embedding
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest224.3 GB
ReasoningTool use
LF
Sakura LFM3-1.7B Uncensored
Lfm · webmp3
Params1.73B
Context256K
Smallest1.8 GB
ReasoningTool use
QW
Sakura Qwen3.8 27B EfficientThink GSQ RCO Hybrid
Qwen · webmp3
Params26.9B
Context256K
Smallest10.7 GB
ReasoningTool use
QW
qwen2.5-0.5b-instruct
Qwen · webmp3
Params630M
Context32K
Smallest0.4 GB
Tool use
NA
Sakura Nanbeige4.2 3B
Nanbeige · webmp3
Params4.17B
Context256K
Smallest1.8 GB
GGUF
FA
Fara1.5 4B
Fara · webmp3
Params4.21B
Context256K
Smallest2.0 GB
Vision
QW
qwen2.5-0.5b-instruct
Qwen · webmp3
Params630M
Context32K
Smallest0.4 GB
Tool use

Keep browsing