GGUF models by webmp3

88 GGUF models quantized by webmp3 on Hugging Face. Sizes run from 135M to 748B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Jais-3-32B
Jais · webmp3
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use
HU
Sakura humanizer 12B
Humanizer · webmp3
Params11.9B
Context256K
Smallest4.9 GB
GGUF
SP
Sakura Spark X2.5 4B
Spark · webmp3
Params4.11B
Context1024K
Smallest1.8 GB
ReasoningTool use
SP
Sakura Spark X2.6 1.7B
Spark · webmp3
Params1.71B
Context1024K
Q4_K_M1.1 GB
ReasoningTool use
QW
Sakura Qwen3.8 Flash Next ISTA 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.4 GB
ReasoningTool use
QW
Qwen3 8B
Qwen · webmp3
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
GR
Granite 4.2 8b
Granite · webmp3
Params8.79B
Context128K
Smallest3.6 GB
ReasoningTool use
DE
Sakura DeepSeek V4.1 Flash 1017 Maya S IQ2 XXS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest262.7 GB
GGUF
SA
Sage-A1.5
Sage · webmp3
Params35.5B
Context256K
Smallest25.3 GB
ReasoningTool useVision
RI
Ripple-65B-Preview
Ripple · webmp3
Params64.8B
Context2048K
Q4_K_M38.8 GB
ReasoningTool use
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest156.0 GB
GGUF
QW
Sakura Whittle Qwen 3.8 45B A3B
Qwen · webmp3
Params45.1B
Context256K
Q4_K_M27.1 GB
ReasoningTool use
LL
Llama 3.3 70B Instruct
Llama · webmp3
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ2 XS 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest52.7 GB
ReasoningTool use
QW
Sakura Qwen3.8 Flash Next ISTA Darwin R3 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest63.0 GB
ReasoningTool use
SM
Sakura SmolLM2 135M Instruct BF16
SmolLM · webmp3
Params135M
Context8K
Smallest0.3 GB
GGUF
QW
qwen2.5-0.5b-instruct
Qwen · webmp3
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest249.8 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest346.8 GB
ReasoningTool use
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Q4_K_M258.1 GB
GGUF
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest317.9 GB
ReasoningTool use
ME
Sakura MetaEncoder 30B Experiment
Meta · webmp3
Params27.9B
Context128K
Smallest19.7 GB
CodingEmbeddingReasoning
FL
Sakura Flint Q5 K M
Flint · webmp3
Params39.8B
Context256K
Smallest28.3 GB
CodingReasoningTool use
FL
Sakura Flint Q4 K M
Flint · webmp3
Params39.8B
Context256K
Q4_K_M24.2 GB
CodingReasoningTool use
NA
Nanbeige4.3 33B
Nanbeige · webmp3
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest302.9 GB
GGUF
NA
Nanbeige4.3 33B
Nanbeige · webmp3
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest390.1 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest382.4 GB
ReasoningTool use
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest284.1 GB
ReasoningTool use

Keep browsing