GGUF models by sizzlebop
140 GGUF models quantized by sizzlebop on Hugging Face. Sizes run from 27M to 32.8B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 7B
Qwen · sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Mini Coder 1.7b
Mini · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
LF
LFM2 1.2B Tool
Lfm · sizzlebop
Params1.17B
Context125K
Smallest0.7 GB
GE
Gemma 3 27b It
Gemma · sizzlebop
Params27B
Context128K
Q4_K_M16.5 GB
LL
ToolACE 2 Llama 3.1 8B
Llama · sizzlebop
Params8.03B
Context128K
Smallest8.5 GB
CR
Crystal Think V2
Crystal · sizzlebop
Params4.02B
Context32K
Smallest4.3 GB
SH
Shizuku 0.5B
Shizuku · sizzlebop
Params248M
Context512
Smallest0.3 GB
OU
OuteTTS 1.0 0.6B
Outetts · sizzlebop
Params602M
Context40K
Smallest0.4 GB
NA
Nanonets OCR S
Nanonets · sizzlebop
Params3.09B
Context125K
Q4_K_M1.9 GB
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Q4_K_M2.5 GB
KU
Kuwutu 7B
Kuwutu · sizzlebop
Params7.62B
Context32K
Smallest8.1 GB
AD
AdaptThink 7B Delta0.05
Adaptthink · sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
GL
Gliese 4B OSS 0410
Gliese · sizzlebop
Params4.02B
Context256K
Smallest2.4 GB
FA
Q Fable5 27B
Fable · sizzlebop
Params26.9B
Context256K
Smallest28.6 GB
LF
LFM2 1.2B Tool
Lfm · sizzlebop
Params1.17B
Context125K
Smallest1.2 GB
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Q4_K_M5.0 GB
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Smallest8.7 GB
GE
Gemma 3 27b It
Gemma · sizzlebop
Params27B
Context128K
Smallest19.3 GB
DE
CoderO1 DeepSeekR1 Coder 14B Preview Q8 0
DeepSeek · sizzlebop
Params14.8B
Context128K
Smallest15.7 GB
OS
Osmosis Structure 0.6B
Osmosis · sizzlebop
Params596M
Context40K
Smallest0.6 GB
SE
Seed Coder 8B Instruct
Seed · sizzlebop
Params8.25B
Context32K
Smallest8.8 GB
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Smallest2.8 GB
LU
Lucy IQ4 NL
Lucy · sizzlebop
Params1.72B
Context40K
Smallest1.1 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest3.4 GB
VI
VibeThinker 1.5B
Vibethinker · sizzlebop
Params1.78B
Context128K
Smallest1.3 GB
RA
Raptor X2
Raptor · sizzlebop
Params14.8B
Context117K
Q4_K_M9.0 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · sizzlebop
Params8.19B
Context128K
Smallest8.7 GB
GL
Gliese 4B OSS 0410
Gliese · sizzlebop
Params4.02B
Context256K
Smallest4.3 GB
QW
Qwen3.5 9B Fable 5 v1
Qwen · sizzlebop
Params9.2B
Context256K
Smallest9.8 GB
VI
VibeThinker 1.5B
Vibethinker · sizzlebop
Params1.78B
Context128K
Smallest1.9 GB