GGUF models by sizzlebop

140 GGUF models quantized by sizzlebop on Hugging Face. Sizes run from 27M to 32.8B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B
Qwen · sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
MI
Mini Coder 1.7b
Mini · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
Coding
LF
LFM2 1.2B Tool
Lfm · sizzlebop
Params1.17B
Context125K
Smallest0.7 GB
Tool use
GE
Gemma 3 27b It
Gemma · sizzlebop
Params27B
Context128K
Q4_K_M16.5 GB
Vision
LL
ToolACE 2 Llama 3.1 8B
Llama · sizzlebop
Params8.03B
Context128K
Smallest8.5 GB
CodingTool use
CR
Crystal Think V2
Crystal · sizzlebop
Params4.02B
Context32K
Smallest4.3 GB
Reasoning
SH
Shizuku 0.5B
Shizuku · sizzlebop
Params248M
Context512
Smallest0.3 GB
GGUF
OU
OuteTTS 1.0 0.6B
Outetts · sizzlebop
Params602M
Context40K
Smallest0.4 GB
GGUF
NA
Nanonets OCR S
Nanonets · sizzlebop
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Q4_K_M2.5 GB
Reasoning
KU
Kuwutu 7B
Kuwutu · sizzlebop
Params7.62B
Context32K
Smallest8.1 GB
CodingReasoningRoleplay
AD
AdaptThink 7B Delta0.05
Adaptthink · sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
GL
Gliese 4B OSS 0410
Gliese · sizzlebop
Params4.02B
Context256K
Smallest2.4 GB
Coding
FA
Q Fable5 27B
Fable · sizzlebop
Params26.9B
Context256K
Smallest28.6 GB
GGUF
LF
LFM2 1.2B Tool
Lfm · sizzlebop
Params1.17B
Context125K
Smallest1.2 GB
Tool use
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Smallest8.7 GB
GGUF
GE
Gemma 3 27b It
Gemma · sizzlebop
Params27B
Context128K
Smallest19.3 GB
Vision
DE
CoderO1 DeepSeekR1 Coder 14B Preview Q8 0
DeepSeek · sizzlebop
Params14.8B
Context128K
Smallest15.7 GB
CodingTool use
OS
Osmosis Structure 0.6B
Osmosis · sizzlebop
Params596M
Context40K
Smallest0.6 GB
GGUF
SE
Seed Coder 8B Instruct
Seed · sizzlebop
Params8.25B
Context32K
Smallest8.8 GB
Coding
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Smallest2.8 GB
Reasoning
LU
Lucy IQ4 NL
Lucy · sizzlebop
Params1.72B
Context40K
Smallest1.1 GB
GGUF
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest3.4 GB
GGUF
VI
VibeThinker 1.5B
Vibethinker · sizzlebop
Params1.78B
Context128K
Smallest1.3 GB
Coding
RA
Raptor X2
Raptor · sizzlebop
Params14.8B
Context117K
Q4_K_M9.0 GB
CodingReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · sizzlebop
Params8.19B
Context128K
Smallest8.7 GB
ReasoningTool use
GL
Gliese 4B OSS 0410
Gliese · sizzlebop
Params4.02B
Context256K
Smallest4.3 GB
Coding
QW
Qwen3.5 9B Fable 5 v1
Qwen · sizzlebop
Params9.2B
Context256K
Smallest9.8 GB
CodingReasoningTool use
VI
VibeThinker 1.5B
Vibethinker · sizzlebop
Params1.78B
Context128K
Smallest1.9 GB
Coding

Keep browsing