GGUF models by larenspear

47 GGUF models quantized by larenspear on Hugging Face. Sizes run from 129M to 34.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · larenspear
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · larenspear
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
OL
OLMo-7B-Instruct-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
WI
WildLlama-7b-user-assistant
Wildllama · larenspear
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · larenspear
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
OP
OpenELM-270M-Instruct
Openelm · larenspear
Params272M
Context2K
Q4_K_M0.2 GB
GGUF
BI
bitnet_b1_58-3B
Bitnet · larenspear
Params3.32B
Context2K
Q4_K_M2.5 GB
GGUF
WI
WildLlama-7b-assistant-only
Wildllama · larenspear
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
OpenELM-3B-Instruct
Openelm · larenspear
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
OP
OpenELM-1_1B-Instruct
Openelm · larenspear
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
LL
llama2 13b WildJailbreak
Llama · larenspear
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
yo-Llama-3-8B-Instruct
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
bitnet_b1_58-large
Bitnet · larenspear
Params729M
Context2K
Q4_K_M0.5 GB
GGUF
OP
OpenELM-450M-Instruct
Openelm · larenspear
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
OL
OLMo-7B-Twin-2T-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
DE
DeepSeek V2 Lite
DeepSeek · larenspear
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · larenspear
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · larenspear
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MA
mamba 370m hf
Mamba · larenspear
Params372M
Context1024K
Q4_K_M0.3 GB
GGUF
MA
mamba 130m hf
Mamba · larenspear
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
MA
mamba 2.8b hf
Mamba · larenspear
Params2.77B
Context1024K
Q4_K_M2.0 GB
GGUF
OL
OLMo-7B-SFT-hf
OLMo · larenspear
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
LL
llama2 7b WildJailbreak
Llama · larenspear
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MA
mamba 1.4b hf
Mamba · larenspear
Params1.37B
Context1024K
Q4_K_M1.0 GB
GGUF
LL
finance-Llama3-8B
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NU
nuextract
Nuextract · larenspear
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · larenspear
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MA
mamba 790m hf
Mamba · larenspear
Params793M
Context1024K
Q4_K_M0.6 GB
GGUF
LL
Llama3-ChatQA-1.5-8B-copy
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ON
oneirogen-7B
Oneirogen · larenspear
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

About larenspear on Hugging Face

larenspear has published 47 GGUF models that ggufmodels.com tracks, across families such as Yi, Llama and Mamba. The most downloaded are TinyLlama-1.1B-Chat-v1.0, Yi-1.5-6B-Chat and OLMo-7B-Instruct-hf.

The quants larenspear publishes most often are Q2_K (39), Q8_0 (38), Q6_K (38) and Q5_K_M (38). Their Q4_K_M files range from 0.1 to 10.4 GB. Parameter counts run from 129M to 34.4B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has larenspear published?

47 models are listed here, mainly from the Yi, Llama and Mamba families. The most downloaded is TinyLlama-1.1B-Chat-v1.0.

Which quants does larenspear publish?

The most common are Q2_K (39 models), Q8_0 (38 models), Q6_K (38 models) and Q5_K_M (38 models).

Keep browsing