GGUF models by BeaverAI
381 GGUF models quantized by BeaverAI on Hugging Face. Sizes run from 1.72B to 141B parameters. The longest trained context is 1000K tokens.
BE
Behemoth X 123B v2e
Behemoth · BeaverAI
Params123B
Context128K
Q4_K_M73.2 GB
RO
Rocinante X 12B v1c
Rocinante · BeaverAI
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma3 6B v1a
Gemma · BeaverAI
Params5.58B
Context128K
Smallest5.9 GB
GE
Tiger Gemma 12B v3a
Gemma · BeaverAI
Params12.8B
Context128K
Q4_K_M7.9 GB
RO
Rocinante 12B v1a
Rocinante · BeaverAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemmasutra 4B v3a
Gemma · BeaverAI
Params3.88B
Context128K
Q4_K_M2.5 GB
AN
Anubis 70B v1p
Anubis · BeaverAI
Params70.6B
Context128K
Q4_K_M42.5 GB
CY
Cydonia 24B v4t
Cydonia · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
SO
Sophon 4B V1D Workspace
Sophon · BeaverAI
Params4.02B
Context256K
Q4_K_M2.5 GB
TE
Test 12B v1b
Test · BeaverAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Fallen Mistral Small 3.1 24B V1E
Mistral · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
RO
Rocinante R1 12B v1b
Rocinante · BeaverAI
Params12.2B
Context128K
Q4_K_M7.5 GB
CY
Cydonia R1 24B v4b
Cydonia · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemmasutra Mini 2B v2r
Gemma · BeaverAI
Params2.61B
Context8K
Q4_K_M1.7 GB
BR
Brother Dusk 14B v1c
Brother · BeaverAI
Params13.5B
Context256K
Q4_K_M8.2 GB
SN
Snowpiercer 15B v1d
Snowpiercer · BeaverAI
Params15B
Context64K
Q4_K_M9.1 GB
CY
Cydonia 24B v4y
Cydonia · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
AR
Artemis 31B v1l
Artemis · BeaverAI
Params30.7B
Context256K
Q4_K_M18.7 GB
AN
Anubis Mini 8B v1d
Anubis · BeaverAI
Params8.03B
Context128K
Q4_K_M4.9 GB
RO
Rocinante 12B v2m
Rocinante · BeaverAI
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemmasutra Pro 27B v1f
Gemma · BeaverAI
Params27.2B
Context8K
Q4_K_M16.6 GB
BR
Brother Dusk 14B V1A Workspace
Brother · BeaverAI
Params13.5B
Context256K
Q4_K_M8.2 GB
AN
Anubis Mini 8B v1a
Anubis · BeaverAI
Params8.03B
Context128K
Q4_K_M4.9 GB
SK
Skyfall 31B v4b
Skyfall · BeaverAI
Params31.4B
Context128K
Q4_K_M19.0 GB
GE
Fallen Gemma3 4B V1C
Gemma · BeaverAI
Params3.88B
Context128K
Q4_K_M2.5 GB
CY
Cydonia 24B v3f
Cydonia · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
VO
Voxtral RP 3B V1B Workspace
Voxtral · BeaverAI
Params3.61B
Context32K
Q4_K_M2.2 GB
MI
Magistral 24B Full Ablit
Mistral · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
AR
Artemis 31B v1f
Artemis · BeaverAI
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemmasutra 12B v3a
Gemma · BeaverAI
Params11.8B
Context128K
Q4_K_M7.3 GB