GGUF models by bunnycore
161 GGUF models quantized by bunnycore on Hugging Face. Sizes run from 1M to 14.7B parameters. The longest trained context is 1024K tokens.
QW
Qwen3 4B RP
Qwen · bunnycore
Params4.02B
Context32K
Smallest3.3 GB
LL
Llama 3.2 3B ProdigyPlusPlus IQ4 NL
Llama · bunnycore
Params3.61B
Context128K
Smallest2.1 GB
GE
gemma-1.1-7b-it
Gemma · bunnycore
Params8.54B
Context8K
Smallest6.1 GB
LL
Llama 3.1 8B TitanFusion Mix 2.1 Q4 K M
Llama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Crazy Qwen2 7b IQ4 NL
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.4 GB
LL
Llama 3.2 3B Mix Skill IQ4 XS
Llama · bunnycore
Params3.61B
Context128K
Smallest2.0 GB
NO
L3 NotCrazy 8B Q4 K M
Notcrazy · bunnycore
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3.5 Mini ChatML Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB
HY
HyperLLama3.1 Mix 8B Q4 K M
Hyperllama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLama 3.2 1B General Lora_Model
Llama · bunnycore
Params11M
Context—
Smallest0.0 GB
PH
Phi 3.5 mini TitanFusion V2 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
PH
Phigments12 Q6 K
Phigments · bunnycore
Params2.78B
Context2K
Smallest2.3 GB
QW
Qwen2.5 3B Model Stock Q8 0
Qwen · bunnycore
Params3.4B
Context32K
Smallest3.6 GB
LL
Llama 3.2 3B Stock v1 Q5 K M
Llama · bunnycore
Params3.21B
Context128K
Smallest2.3 GB
PH
Phi 3.5 mini TitanFusion 0.1 Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB
LL
Llama 3.1 8B TitanFusion Mix 2 Q4 K M
Llama · bunnycore
Params8.03B
Context8K
Q4_K_M4.9 GB
QA
Qandora 2.5 7B
Qandora · bunnycore
Params7.62B
Context32K
Smallest4.2 GB
LL
LLamaPhi3 Q5 K M
Llama · bunnycore
Params4.83B
Context128K
Smallest3.5 GB
TU
Tulu 3.1 8B SuperNova
Tulu · bunnycore
Params8.03B
Context128K
Smallest4.4 GB
MA
Maverick-8B
Maverick · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
QW
FwF Qwen 7B 0.1 Q5 K M
Qwen · bunnycore
Params7.62B
Context32K
Smallest5.4 GB
QW
Qwen2.5 7B Sky R1 Mini Q5 K M
Qwen · bunnycore
Params7.62B
Context986K
Smallest5.4 GB
SP
SparrowMind-8B
Sparrowmind · bunnycore
Params8.03B
Context8K
Smallest5.7 GB
FA
Falcon3 3B RP V0.1 Q5 K M
Falcon · bunnycore
Params3.23B
Context32K
Smallest2.3 GB
QW
Qwen 2.5 7b TitanFusion v5 Exp IQ4 NL
Qwen · bunnycore
Params7.62B
Context32K
Smallest4.4 GB
LL
LLama 3.1 Hyper Stock Q5 K M
Llama · bunnycore
Params8.03B
Context128K
Smallest5.7 GB
QW
Qwen2.5 3B Smart Q5 K M
Qwen · bunnycore
Params3.4B
Context32K
Smallest2.4 GB
HY
HyperLlama3.1 v2 Q4 K M
Hyperllama · bunnycore
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Prodigy IQ4 NL
Llama · bunnycore
Params3.61B
Context128K
Smallest2.1 GB
PH
Phi 3.5 Mini Sonet RP V2 Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB