GGUF models by sizzlebop
140 GGUF models quantized by sizzlebop on Hugging Face. Sizes run from 27M to 32.8B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 7B Minperplexity 2
Qwen · sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
X1
x1 7B v0.1 Q4 K M
sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3 0.6B Base
Qwen · sizzlebop
Params596M
Context32K
Smallest0.6 GB
LF
LFM2 VL 450M
Lfm · sizzlebop
Params354M
Context125K
Smallest0.2 GB
HI
Hisoka-1B
Hisoka · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
GR
Granite 4.0 H Tiny
Granite · sizzlebop
Params6.94B
Context1024K
Smallest7.4 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest1.9 GB
AD
AdaptThink 7B Delta0.05
Adaptthink · sizzlebop
Params7.62B
Context128K
Smallest4.2 GB
QW
Qwen3 4B NexusPrime
Qwen · sizzlebop
Params4.02B
Context40K
Smallest2.3 GB
SN
Snowpiercer 15B v3
Snowpiercer · sizzlebop
Params15B
Context64K
Smallest15.9 GB
LL
ToolACE 2 Llama 3.1 8B
Llama · sizzlebop
Params8.03B
Context128K
Q4_K_M4.9 GB
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Smallest8.1 GB
GR
Granite 3.3 2b Instruct
Granite · sizzlebop
Params2.53B
Context128K
Q4_K_M1.5 GB
SA
Sarvam M
Sarvam · sizzlebop
Params23.6B
Context32K
Smallest25.1 GB
QW
Qwen3 0.6B
Qwen · sizzlebop
Params752M
Context40K
Smallest0.6 GB
QW
Qwen3 4B NexusPrime
Qwen · sizzlebop
Params4.02B
Context40K
Smallest4.3 GB
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Smallest2.4 GB
GE
Gemma3-0.27B-SwissprotQA-SFT-Family
Gemma · sizzlebop
Params268M
Context32K
Smallest0.3 GB
VI
Viper OneCoder UIGEN
Viper · sizzlebop
Params14.8B
Context32K
Smallest15.7 GB
MA
MarLin 7b Q8 0
Marlin · sizzlebop
Params6.74B
Context4K
Smallest7.2 GB
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Smallest5.7 GB
GO
GOIDA-0.5B
Goida · sizzlebop
Params494M
Context32K
Smallest0.5 GB
MU
Multilingual SaigaSuzume 8B Q8 0
Multilingual · sizzlebop
Params8.03B
Context128K
Smallest8.5 GB
LU
Lucy Q8 0
Lucy · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
CA
Capricornus MoT 1.7B Supreme1
Capricornus · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
DR
Draco CoderMini 3B
Draco · sizzlebop
Params3.09B
Context32K
Smallest3.3 GB
SM
SmolLM2 135M Instruct
SmolLM · sizzlebop
Params135M
Context8K
Smallest0.1 GB
QW
oh dcft v3.1 claude 3 5 haiku 20241022 qwen Q4 K M
Qwen · sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
X1
x1 7B v0.1 Q8 0
sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
GR
Gradience T1 7B Preview
Gradience · sizzlebop
Params7.62B
Context32K
Smallest8.1 GB