GGUF models by jeiku

89 GGUF models quantized by jeiku on Hugging Face. Sizes run from 2.17B to 16B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
SOVL Llama3 8B Q4 K M
Llama · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MA
Mangolian
Mangolian · jeiku
Params4.51B
Context128K
Smallest2.6 GB
GGUF
T9
T-900-8B
jeiku
Params8.03B
Context8K
Smallest3.7 GB
GGUF
KU
Pasta PrimaMaid 7b
Kunocchini · jeiku
Params7.24B
Context8K
Smallest2.7 GB
GGUF
BE
Berry_v2_7B
Berry · jeiku
Params7.62B
Context32K
Smallest4.5 GB
GGUF
RO
Rosa v2 3B
Rosa · jeiku
Params2.8B
Context4K
Smallest1.2 GB
GGUF
LL
Kei Llama3 8B Q4 K M
Llama · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
Aura Index 1.9B
Aura · jeiku
Params2.17B
Context4K
Smallest2.3 GB
GGUF
QW
qwen2base
Qwen · jeiku
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
NO
Nous-Capybara-3B-V1.9
Nous · jeiku
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
RO
Rosa v1 7B
Rosa · jeiku
Params7.24B
Context32K
Smallest3.1 GB
GGUF
QW
qwen2-7b-magpie300k_filtered_epoch2
Qwen · jeiku
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Auraphin_Qwen2_7B
Qwen · jeiku
Params7.62B
Context128K
Smallest3.5 GB
GGUF
RO
Rosa v3 3B
Rosa · jeiku
Params2.8B
Context4K
Smallest1.2 GB
GGUF
TE
Chaos RP l3 8B Q4 K M
Test · jeiku
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
T8
T-850-8B
jeiku
Params8.03B
Context8K
Smallest3.7 GB
GGUF
MO
MoEfixed Q4 0
Moefixed · jeiku
Params7.23B
Context128K
Smallest4.2 GB
GGUF
PH
Eggs and Bacon RP Phi 3
Phi · jeiku
Params3.82B
Context4K
Smallest2.4 GB
Roleplay
EV
General Purpose 3B
Everything · jeiku
Params2.8B
Context4K
Smallest1.1 GB
GGUF
GE
Gemma2Tester
Gemma · jeiku
Params2.51B
Context8K
Smallest2.1 GB
GGUF
ZE
Zephyr_beta_32k_7B
Zephyr · jeiku
Params7.24B
Context32K
Smallest5.0 GB
GGUF
CH
Chili Dog 8B Q6 K
Chili · jeiku
Params8.41B
Context8K
Smallest6.9 GB
GGUF
QW
Aura_Qwen2_v3_7B
Qwen · jeiku
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Very_Berry_Qwen2_7B
Qwen · jeiku
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Aura_Qwen_7B
Qwen · jeiku
Params7.62B
Context128K
Smallest3.5 GB
GGUF
PH
Kiss Me Im Irish Phi 3
Phi · jeiku
Params3.82B
Context4K
Smallest2.4 GB
GGUF
TE
Templar_v1_8B
Templar · jeiku
Params8.03B
Context8K
Smallest3.7 GB
GGUF
HO
HollandV2 F16
Hollandv · jeiku
Params4.51B
Context128K
Smallest9.0 GB
GGUF
AU
Aura_3B
Aura · jeiku
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF

Keep browsing