GGUF models by bunnycore

161 GGUF models quantized by bunnycore on Hugging Face. Sizes run from 1M to 14.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma4 E2B Qwen Distill 2.0 Lora
Gemma · bunnycore
Params54M
Context—
Smallest0.1 GB
GGUF
MI
SuperMiniCPM5 2B
MiniCPM · bunnycore
Params50M
Context—
Smallest0.1 GB
GGUF
PH
Phi 3.5 mini dare ties Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
KA
kappa 3 phi abliterated Q5 K M
Kappa · bunnycore
Params3.82B
Context4K
Smallest2.8 GB
GGUF
LL
Llama 3.1 8b breadcrumbs ties Q4 K M
Llama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B OmniMatrix
Llama · bunnycore
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama 3.2 3B Pure RP Q5 K M
Llama · bunnycore
Params3.21B
Context128K
Smallest2.3 GB
RoleplayTool use
LL
Llama 3.1 8B TitanFusion Q4 K M
Llama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B
Qwen · bunnycore
Params7.62B
Context128K
Smallest4.2 GB
Tool use
QW
Qwen2.5 7B Matrix v2 IQ4 XS
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.2 GB
Tool use
QW
Qwen3 1.7B FreeSteer v2
Qwen · bunnycore
Params1.72B
Context40K
Smallest1.4 GB
ReasoningTool use
CO
CodeZero 7B Q5 K S
Codezero · bunnycore
Params8.99B
Context32K
Smallest6.2 GB
GGUF
GE
Gemma4 E2 Code Lora
Gemma · bunnycore
Params25M
Context—
Smallest0.0 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.2 GB
GGUF
QW
Qwen 2.5 3b Evol CoT
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
Tool use
ST
StockLLama 3.1 8B Q4 K M
Stockllama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 3B
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.8 GB
Tool use
LL
Llama 3.2 3B Mix IQ4 XS
Llama · bunnycore
Params3.61B
Context128K
Smallest2.0 GB
Tool use
LL
Llama 3.2 3B Sci Think IQ4 NL
Llama · bunnycore
Params3.21B
Context128K
Smallest1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.8 GB
GGUF
QW
Qwen 2.5 7b TitanFusion v3 IQ4 NL
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.4 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.4 GB
GGUF
GE
Gemma2 2B mixed Q5 K M
Gemma · bunnycore
Params2.61B
Context8K
Smallest1.9 GB
GGUF
QW
Qwen2.5 3B
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
Tool use
QW
Replete Qwen 2.5 3b CoT RP IQ4 NL
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.0 GB
RoleplayTool use
LL
Llama 3.2 3B Creative Q5 K M
Llama · bunnycore
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
LlamaTronic 3.1 4B IQ4 NL
Llama · bunnycore
Params4.51B
Context128K
Smallest2.7 GB
GGUF
QW
Qwen2.5 7B Exp2 Lora_Model
Qwen · bunnycore
Params40M
Context—
Smallest0.2 GB
GGUF
ST
Starling dolphin E26 7B Q5 K M
Starling · bunnycore
Params7.24B
Context32K
Smallest5.1 GB
GGUF
LL
Smol Llama 3.2 3B Q5 K M
Llama · bunnycore
Params3.61B
Context128K
Smallest2.6 GB
Tool use

Keep browsing