GGUF models by webmp3
88 GGUF models quantized by webmp3 on Hugging Face. Sizes run from 135M to 748B parameters. The longest trained context is 1024K tokens.
JA
Jais-3-32B
Jais · webmp3
Params34.8B
Context512K
Q4_K_M21.1 GB
HU
Sakura humanizer 12B
Humanizer · webmp3
Params11.9B
Context256K
Smallest4.9 GB
SP
Sakura Spark X2.5 4B
Spark · webmp3
Params4.11B
Context1024K
Smallest1.8 GB
SP
Sakura Spark X2.6 1.7B
Spark · webmp3
Params1.71B
Context1024K
Q4_K_M1.1 GB
QW
Sakura Qwen3.8 Flash Next ISTA 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.4 GB
QW
Qwen3 8B
Qwen · webmp3
Params8.19B
Context32K
Q4_K_M5.0 GB
GR
Granite 4.2 8b
Granite · webmp3
Params8.79B
Context128K
Smallest3.6 GB
DE
Sakura DeepSeek V4.1 Flash 1017 Maya S IQ2 XXS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest262.7 GB
SA
Sage-A1.5
Sage · webmp3
Params35.5B
Context256K
Smallest25.3 GB
RI
Ripple-65B-Preview
Ripple · webmp3
Params64.8B
Context2048K
Q4_K_M38.8 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest156.0 GB
QW
Sakura Whittle Qwen 3.8 45B A3B
Qwen · webmp3
Params45.1B
Context256K
Q4_K_M27.1 GB
LL
Llama 3.3 70B Instruct
Llama · webmp3
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ2 XS 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest52.7 GB
QW
Sakura Qwen3.8 Flash Next ISTA Darwin R3 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest63.0 GB
SM
Sakura SmolLM2 135M Instruct BF16
SmolLM · webmp3
Params135M
Context8K
Smallest0.3 GB
QW
qwen2.5-0.5b-instruct
Qwen · webmp3
Params630M
Context32K
Q4_K_M0.5 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest249.8 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest346.8 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Q4_K_M258.1 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest317.9 GB
ME
Sakura MetaEncoder 30B Experiment
Meta · webmp3
Params27.9B
Context128K
Smallest19.7 GB
FL
Sakura Flint Q5 K M
Flint · webmp3
Params39.8B
Context256K
Smallest28.3 GB
FL
Sakura Flint Q4 K M
Flint · webmp3
Params39.8B
Context256K
Q4_K_M24.2 GB
NA
Nanbeige4.3 33B
Nanbeige · webmp3
Params33.1B
Context512K
Q4_K_M20.1 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest302.9 GB
NA
Nanbeige4.3 33B
Nanbeige · webmp3
Params33.1B
Context512K
Q4_K_M20.1 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest390.1 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest382.4 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest284.1 GB