Base GGUF models
127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.
BA
e5 base v2 gguf q4 k m
Base · keisuke-miyako
Params109M
Context512
Q4_K_M0.1 GB
BA
S1 Base 32B
Base · StephenGenusa
Params32.8B
Context128K
Smallest22.6 GB
BA
e5 base v2 Q8 0
Base · velyan
Params109M
Context512
Smallest0.1 GB
BA
8b Base Academic 14 Q5 K M
Base · jaspionjader
Params8.03B
Context1024K
Smallest5.7 GB
BA
3b_or_base
Base · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
BA
Lazycuber L2 7b Base Guanaco Vicuna
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
BA
e5 base v2 gguf f16
Base · keisuke-miyako
Params109M
Context512
Smallest0.2 GB
BA
base 7B
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
BA
S1 Base 32B
Base · lieren2023
Params32.8B
Context128K
Smallest34.8 GB
BA
base_test_3_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
S1 Base 671B i1
Base · mradermacher
Params252M
Context—
Smallest1.0 GB
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.1 GB
BA
T5 Base
Base · andtt
Params223M
Context512
Smallest0.2 GB
BA
e5 base v2 Q4 K M
Base · abhiraj1
Params109M
Context512
Q4_K_M0.1 GB
BA
K2 V2 base final
Base · mesh-ops
Params72.6B
Context32K
Smallest51.5 GB
BA
base_test_4_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
base_test_2_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
base_test_4_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
DM2 BASE2
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.3 GB
BA
T5 Base
Base · egrhfnfdg
Params223M
Context512
Q4_K_M0.1 GB
BA
base_test_2_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
base_test_3_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
BA
S1 Base 32B
Base · jsfs11
Params32.8B
Context128K
Q4_K_M19.8 GB
BA
Base10
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
BA
T5 Base
Base · ArchaonX
Params223M
Context512
Q4_K_M0.1 GB
BA
J.O.S.I.E. 2x7B base
Base · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
BA
8b Base Academic 5 Q5 K M
Base · jaspionjader
Params8.03B
Context1024K
Smallest5.7 GB
BA
T5 Base
Base · mrbutter
Params223M
Context512
Q4_K_M0.1 GB
BA
Base11
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB