GGUF models by bunnycore

161 GGUF models quantized by bunnycore on Hugging Face. Sizes run from 1M to 14.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B Booval IQ4 NL
Llama · bunnycore
Params3.21B
Context128K
Smallest1.9 GB
Tool use
PH
Phi 3.5 mini TitanFusion 0.6 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
GGUF
LL
Llama 3.2 1B Creative RP Q8 0
Llama · bunnycore
Params1.24B
Context128K
Smallest1.3 GB
Roleplay
QW
Qwen 2.5 3B Remix IQ4 NL
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
Tool use
LL
Llama 3.2 3B RP DeepThink Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
RoleplayTool use
HY
HyperLLama3.1 8b Nova Q5 K M
Hyperllama · bunnycore
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama 3.2 1b Chatml RP Q5 K M
Llama · bunnycore
Params1.5B
Context128K
Smallest1.1 GB
RoleplayTool use
IN
L3 Intermix v0.1 Q5 K M
Intermix · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LL
Llama 3.2 3B Deep Test Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
Tool use
LL
Llama 3.2 3B Bespoke Thought Q8 0
Llama · bunnycore
Params3.21B
Context128K
Smallest3.4 GB
Tool use
CO
Cognitron-8B
Cognitron · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
GGUF
HY
HyperGemma 2 9B Q4 K M
Hypergemma · bunnycore
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.2 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
GGUF
HY
HyperLlama 3.1 8B IQ4 NL
Hyperllama · bunnycore
Params8.03B
Context128K
Smallest4.7 GB
Tool use
GE
Gemma2 2B Chaos Q5 K M
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.9 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.4 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
GGUF
SM
SmartToxic 7B Q5 K S
Smarttoxic · bunnycore
Params7.24B
Context8K
Smallest5.0 GB
GGUF
PH
Phi 3.5 Mini Sonet RP Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
Roleplay
QW
Qwen2.5 7B
Qwen · bunnycore
Params7.62B
Context128K
Smallest4.4 GB
Tool use
LL
Llama 3.2 3B All Mix Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
Tool use
QA
Qandora 2.5 7B Q5 K M
Qandora · bunnycore
Params7.62B
Context32K
Smallest5.4 GB
Tool use
GE
Gemma 3 4B StockMix
Gemma · bunnycore
Params3.88B
Context128K
Smallest3.2 GB
GGUF
GE
Gemma2 9b Max Q4 K M
Gemma · bunnycore
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b TitanFusion IQ4 XS
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.6 GB
GGUF
GE
Gemma 2 2b TitanFusion
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.6 GB
GGUF
MI
Mixtronix 8B IQ4 NL
Mixtronix · bunnycore
Params8.41B
Context8K
Smallest4.9 GB
GGUF
LL
Llama3-OneForAll-8B
Llama · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
GGUF
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · bunnycore
Params3.82B
Context128K
Smallest2.1 GB
GGUF
LL
Llama 3.2 3B Della Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
Tool use
QA
QandoraExp 7B Q5 K M
Qandoraexp · bunnycore
Params7.62B
Context128K
Smallest5.4 GB
Tool use

Keep browsing