GGUF models by jeiku
89 GGUF models quantized by jeiku on Hugging Face. Sizes run from 2.17B to 16B parameters. The longest trained context is 1000K tokens.
LL
SOVL Llama3 8B Q4 K M
Llama · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Mangolian
Mangolian · jeiku
Params4.51B
Context128K
Smallest2.6 GB
T9
T-900-8B
jeiku
Params8.03B
Context8K
Smallest3.7 GB
KU
Pasta PrimaMaid 7b
Kunocchini · jeiku
Params7.24B
Context8K
Smallest2.7 GB
BE
Berry_v2_7B
Berry · jeiku
Params7.62B
Context32K
Smallest4.5 GB
RO
Rosa v2 3B
Rosa · jeiku
Params2.8B
Context4K
Smallest1.2 GB
LL
Kei Llama3 8B Q4 K M
Llama · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
AU
Aura Index 1.9B
Aura · jeiku
Params2.17B
Context4K
Smallest2.3 GB
QW
qwen2base
Qwen · jeiku
Params7.62B
Context32K
Q4_K_M4.7 GB
NO
Nous-Capybara-3B-V1.9
Nous · jeiku
Params2.8B
Context4K
Q4_K_M1.7 GB
RO
Rosa v1 7B
Rosa · jeiku
Params7.24B
Context32K
Smallest3.1 GB
QW
qwen2-7b-magpie300k_filtered_epoch2
Qwen · jeiku
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Auraphin_Qwen2_7B
Qwen · jeiku
Params7.62B
Context128K
Smallest3.5 GB
RO
Rosa v3 3B
Rosa · jeiku
Params2.8B
Context4K
Smallest1.2 GB
TE
Chaos RP l3 8B Q4 K M
Test · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
T8
T-850-8B
jeiku
Params8.03B
Context8K
Smallest3.7 GB
MO
MoEfixed Q4 0
Moefixed · jeiku
Params7.23B
Context128K
Smallest4.2 GB
PH
Eggs and Bacon RP Phi 3
Phi · jeiku
Params3.82B
Context4K
Smallest2.4 GB
EV
General Purpose 3B
Everything · jeiku
Params2.8B
Context4K
Smallest1.1 GB
GE
Gemma2Tester
Gemma · jeiku
Params2.51B
Context8K
Smallest2.1 GB
ZE
Zephyr_beta_32k_7B
Zephyr · jeiku
Params7.24B
Context32K
Smallest5.0 GB
CH
Chili Dog 8B Q6 K
Chili · jeiku
Params8.41B
Context8K
Smallest6.9 GB
QW
Aura_Qwen2_v3_7B
Qwen · jeiku
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Very_Berry_Qwen2_7B
Qwen · jeiku
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Aura_Qwen_7B
Qwen · jeiku
Params7.62B
Context128K
Smallest3.5 GB
PH
Kiss Me Im Irish Phi 3
Phi · jeiku
Params3.82B
Context4K
Smallest2.4 GB
TE
Templar_v1_8B
Templar · jeiku
Params8.03B
Context8K
Smallest3.7 GB
HO
HollandV2 F16
Hollandv · jeiku
Params4.51B
Context128K
Smallest9.0 GB
AU
Aura_3B
Aura · jeiku
Params2.8B
Context4K
Q4_K_M1.7 GB