GGUF models by bunnycore
161 GGUF models quantized by bunnycore on Hugging Face. Sizes run from 1M to 14.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 3.2 3B Booval IQ4 NL
Llama · bunnycore
Params3.21B
Context128K
Smallest1.9 GB
PH
Phi 3.5 mini TitanFusion 0.6 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
LL
Llama 3.2 1B Creative RP Q8 0
Llama · bunnycore
Params1.24B
Context128K
Smallest1.3 GB
QW
Qwen 2.5 3B Remix IQ4 NL
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
LL
Llama 3.2 3B RP DeepThink Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
HY
HyperLLama3.1 8b Nova Q5 K M
Hyperllama · bunnycore
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.2 1b Chatml RP Q5 K M
Llama · bunnycore
Params1.5B
Context128K
Smallest1.1 GB
IN
L3 Intermix v0.1 Q5 K M
Intermix · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
LL
Llama 3.2 3B Deep Test Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
LL
Llama 3.2 3B Bespoke Thought Q8 0
Llama · bunnycore
Params3.21B
Context128K
Smallest3.4 GB
CO
Cognitron-8B
Cognitron · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
HY
HyperGemma 2 9B Q4 K M
Hypergemma · bunnycore
Params9.24B
Context8K
Q4_K_M5.8 GB
PH
Phi 3.5 mini TitanFusion 0.2 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
HY
HyperLlama 3.1 8B IQ4 NL
Hyperllama · bunnycore
Params8.03B
Context128K
Smallest4.7 GB
GE
Gemma2 2B Chaos Q5 K M
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.9 GB
PH
Phi 3.5 mini TitanFusion 0.4 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
SM
SmartToxic 7B Q5 K S
Smarttoxic · bunnycore
Params7.24B
Context8K
Smallest5.0 GB
PH
Phi 3.5 Mini Sonet RP Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen2.5 7B
Qwen · bunnycore
Params7.62B
Context128K
Smallest4.4 GB
LL
Llama 3.2 3B All Mix Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
QA
Qandora 2.5 7B Q5 K M
Qandora · bunnycore
Params7.62B
Context32K
Smallest5.4 GB
GE
Gemma 3 4B StockMix
Gemma · bunnycore
Params3.88B
Context128K
Smallest3.2 GB
GE
Gemma2 9b Max Q4 K M
Gemma · bunnycore
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b TitanFusion IQ4 XS
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.6 GB
GE
Gemma 2 2b TitanFusion
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.6 GB
MI
Mixtronix 8B IQ4 NL
Mixtronix · bunnycore
Params8.41B
Context8K
Smallest4.9 GB
LL
Llama3-OneForAll-8B
Llama · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · bunnycore
Params3.82B
Context128K
Smallest2.1 GB
LL
Llama 3.2 3B Della Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
QA
QandoraExp 7B Q5 K M
Qandoraexp · bunnycore
Params7.62B
Context128K
Smallest5.4 GB