GGUF models by grimjim
38 GGUF models quantized by grimjim on Hugging Face. Sizes run from 7.24B to 23.6B parameters. The longest trained context is 1000K tokens.
MA
Magnolia v3 medis remix 12B
Magnolia · grimjim
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
kalomaze_qwen2-7b-magpie300k_filtered_epoch2
Qwen · grimjim
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
SauerHuatuoSkywork O1 Llama 3.1 8B
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
infinite lemonade SLERP 7B
Infinite · grimjim
Params7.24B
Context32K
Smallest7.7 GB
GE
Magot v2 Gemma2 8k 9B
Gemma · grimjim
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3 Luminurse v0.2 OAS 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Magnolia v1 12B
Magnum · grimjim
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
llama 3 merge pp instruct 8B
Llama · grimjim
Params8.03B
Context8K
Smallest8.5 GB