GGUF models by bunnycore
161 GGUF models quantized by bunnycore on Hugging Face. Sizes run from 1M to 14.7B parameters. The longest trained context is 1024K tokens.
GE
Gemma4 E2B Qwen Distill 2.0 Lora
Gemma · bunnycore
Params54M
Context—
Smallest0.1 GB
MI
SuperMiniCPM5 2B
MiniCPM · bunnycore
Params50M
Context—
Smallest0.1 GB
PH
Phi 3.5 mini dare ties Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
KA
kappa 3 phi abliterated Q5 K M
Kappa · bunnycore
Params3.82B
Context4K
Smallest2.8 GB
LL
Llama 3.1 8b breadcrumbs ties Q4 K M
Llama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B OmniMatrix
Llama · bunnycore
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.2 3B Pure RP Q5 K M
Llama · bunnycore
Params3.21B
Context128K
Smallest2.3 GB
LL
Llama 3.1 8B TitanFusion Q4 K M
Llama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 7B
Qwen · bunnycore
Params7.62B
Context128K
Smallest4.2 GB
QW
Qwen2.5 7B Matrix v2 IQ4 XS
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.2 GB
QW
Qwen3 1.7B FreeSteer v2
Qwen · bunnycore
Params1.72B
Context40K
Smallest1.4 GB
CO
CodeZero 7B Q5 K S
Codezero · bunnycore
Params8.99B
Context32K
Smallest6.2 GB
GE
Gemma4 E2 Code Lora
Gemma · bunnycore
Params25M
Context—
Smallest0.0 GB
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.2 GB
QW
Qwen 2.5 3b Evol CoT
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
ST
StockLLama 3.1 8B Q4 K M
Stockllama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 3B
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.8 GB
LL
Llama 3.2 3B Mix IQ4 XS
Llama · bunnycore
Params3.61B
Context128K
Smallest2.0 GB
LL
Llama 3.2 3B Sci Think IQ4 NL
Llama · bunnycore
Params3.21B
Context128K
Smallest1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.8 GB
QW
Qwen 2.5 7b TitanFusion v3 IQ4 NL
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.4 GB
SM
SmolLM2 1.7B
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.4 GB
GE
Gemma2 2B mixed Q5 K M
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.9 GB
QW
Qwen2.5 3B
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
QW
Replete Qwen 2.5 3b CoT RP IQ4 NL
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
LL
Llama 3.2 3B Creative Q5 K M
Llama · bunnycore
Params3.21B
Context128K
Smallest2.3 GB
LL
LlamaTronic 3.1 4B IQ4 NL
Llama · bunnycore
Params4.51B
Context128K
Smallest2.7 GB
QW
Qwen2.5 7B Exp2 Lora_Model
Qwen · bunnycore
Params40M
Context—
Smallest0.2 GB
ST
Starling dolphin E26 7B Q5 K M
Starling · bunnycore
Params7.24B
Context32K
Smallest5.1 GB
LL
Smol Llama 3.2 3B Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB