GGUF models by sizzlebop

140 GGUF models quantized by sizzlebop on Hugging Face. Sizes run from 27M to 32.8B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B Minperplexity 2
Qwen · sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
GGUF
X1
x1 7B v0.1 Q4 K M
sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen3 0.6B Base
Qwen · sizzlebop
Params596M
Context32K
Smallest0.6 GB
ReasoningTool use
LF
LFM2 VL 450M
Lfm · sizzlebop
Params354M
Context125K
Smallest0.2 GB
Vision
HI
Hisoka-1B
Hisoka · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · sizzlebop
Params6.94B
Context1024K
Smallest7.4 GB
GGUF
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest1.9 GB
GGUF
AD
AdaptThink 7B Delta0.05
Adaptthink · sizzlebop
Params7.62B
Context128K
Smallest4.2 GB
ReasoningTool use
QW
Qwen3 4B NexusPrime
Qwen · sizzlebop
Params4.02B
Context40K
Smallest2.3 GB
GGUF
SN
Snowpiercer 15B v3
Snowpiercer · sizzlebop
Params15B
Context64K
Smallest15.9 GB
GGUF
LL
ToolACE 2 Llama 3.1 8B
Llama · sizzlebop
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
HO
Holo1 7B
Holo · sizzlebop
Params7.62B
Context125K
Smallest8.1 GB
Vision
GR
Granite 3.3 2b Instruct
Granite · sizzlebop
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
SA
Sarvam M
Sarvam · sizzlebop
Params23.6B
Context32K
Smallest25.1 GB
Reasoning
QW
Qwen3 0.6B
Qwen · sizzlebop
Params752M
Context40K
Smallest0.6 GB
ReasoningTool use
QW
Qwen3 4B NexusPrime
Qwen · sizzlebop
Params4.02B
Context40K
Smallest4.3 GB
GGUF
CR
Crystal Think v1.0
Crystal · sizzlebop
Params4.02B
Context40K
Smallest2.4 GB
Reasoning
GE
Gemma3-0.27B-SwissprotQA-SFT-Family
Gemma · sizzlebop
Params268M
Context32K
Smallest0.3 GB
GGUF
VI
Viper OneCoder UIGEN
Viper · sizzlebop
Params14.8B
Context32K
Smallest15.7 GB
CodingReasoningTool use
MA
MarLin 7b Q8 0
Marlin · sizzlebop
Params6.74B
Context4K
Smallest7.2 GB
GGUF
MI
MiniCPM4 8B
MiniCPM · sizzlebop
Params8.19B
Context32K
Smallest5.7 GB
GGUF
GO
GOIDA-0.5B
Goida · sizzlebop
Params494M
Context32K
Smallest0.5 GB
Tool use
MU
Multilingual SaigaSuzume 8B Q8 0
Multilingual · sizzlebop
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LU
Lucy Q8 0
Lucy · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
GGUF
CA
Capricornus MoT 1.7B Supreme1
Capricornus · sizzlebop
Params1.72B
Context40K
Smallest1.8 GB
CodingReasoningTool use
DR
Draco CoderMini 3B
Draco · sizzlebop
Params3.09B
Context32K
Smallest3.3 GB
Coding
SM
SmolLM2 135M Instruct
SmolLM · sizzlebop
Params135M
Context8K
Smallest0.1 GB
Reasoning
QW
oh dcft v3.1 claude 3 5 haiku 20241022 qwen Q4 K M
Qwen · sizzlebop
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
X1
x1 7B v0.1 Q8 0
sizzlebop
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
GR
Gradience T1 7B Preview
Gradience · sizzlebop
Params7.62B
Context32K
Smallest8.1 GB
ReasoningTool use

Keep browsing