GGUF models by BeaverAI
381 GGUF models quantized by BeaverAI on Hugging Face. Sizes run from 1.72B to 141B parameters. The longest trained context is 1000K tokens.
MI
Fallen Mistral Small 3.1 24B v1b
Mistral · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
CY
Cydonia 24B v2j
Cydonia · BeaverAI
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Fallen Gemma3 27B V1B
Gemma · BeaverAI
Params27B
Context128K
Q4_K_M16.5 GB
TU
Tunguska 39B v1c
Tunguska · BeaverAI
Params39B
Context128K
Q4_K_M23.4 GB
MI
Mixtral 4x3B Base v1a
Mistral · BeaverAI
Params10.8B
Context32K
Smallest11.5 GB
MI
Fallen Mistral R1 24B v1c
Mistral · BeaverAI
Params23.6B
Context32K
Q4_K_M14.3 GB
HU
Hubble 4B v1e
Hubble · BeaverAI
Params4.51B
Context128K
Q4_K_M2.8 GB
GE
Tiger Gemma 9B v2a
Gemma · BeaverAI
Params9.24B
Context8K
Q4_K_M5.8 GB
CY
Cydonia 24B V4Za Workspace
Cydonia · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
SK
Skyfall 31B v4g
Skyfall · BeaverAI
Params31.4B
Context128K
Q4_K_M19.0 GB
GE
Gemmasutra Mini 2B v2v
Gemma · BeaverAI
Params2.61B
Context8K
Q4_K_M1.7 GB
CY
Cydonia 22B v2f
Cydonia · BeaverAI
Params22.2B
Context32K
Q4_K_M13.3 GB
KO
Koto 8B v1a
Koto · BeaverAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Big Tiger Gemma 27B v1b
Gemma · BeaverAI
Params27.2B
Context8K
Smallest19.4 GB
SI
Signal 24B v1c
Signal · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
TE
Test 24B v1a
Test · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
SK
Skyfall 31B V4V Workspace
Skyfall · BeaverAI
Params31.4B
Context128K
Q4_K_M19.0 GB
CY
Cydonia 24B v2i
Cydonia · BeaverAI
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemmasutra Pro 27B v1e
Gemma · BeaverAI
Params27.2B
Context8K
Q4_K_M16.6 GB
SK
Skyfall 31B v4k
Skyfall · BeaverAI
Params31.4B
Context128K
Q4_K_M19.0 GB
GL
GLM Steam 106B A12B v1a
GLM · BeaverAI
Params110B
Context128K
Q4_K_M72.9 GB
AG
Agatha 111B v1b
Agatha · BeaverAI
Params111B
Context256K
Q4_K_M67.1 GB
GE
Fallen Gemma3 27B V1A
Gemma · BeaverAI
Params27B
Context128K
Q4_K_M16.5 GB
HU
Hubble 4B v1d
Hubble · BeaverAI
Params4.51B
Context128K
Q4_K_M2.8 GB
MI
Fallen Mistral Small 3.1 24B v1c
Mistral · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
NA
Nautilus 70B v1h
Nautilus · BeaverAI
Params71B
Context128K
Q4_K_M42.5 GB
SI
Signal 24B v1a
Signal · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemmasutra Mini 2B v2m
Gemma · BeaverAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemmasutra Pro 27B v1c
Gemma · BeaverAI
Params27.2B
Context8K
Q4_K_M16.6 GB
LA
Largestral Ablit
Largestral · BeaverAI
Params123B
Context128K
Q4_K_M73.2 GB