GGUF models by grimjim

38 GGUF models quantized by grimjim on Hugging Face. Sizes run from 7.24B to 23.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Magnolia v3 medis remix 12B
Magnolia · grimjim
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
kalomaze_qwen2-7b-magpie300k_filtered_epoch2
Qwen · grimjim
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
SauerHuatuoSkywork O1 Llama 3.1 8B
Llama · grimjim
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
infinite lemonade SLERP 7B
Infinite · grimjim
Params7.24B
Context32K
Smallest7.7 GB
GGUF
GE
Magot v2 Gemma2 8k 9B
Gemma · grimjim
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3 Luminurse v0.2 OAS 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
Magnolia v1 12B
Magnum · grimjim
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
llama 3 merge pp instruct 8B
Llama · grimjim
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing