Base GGUF models

127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
e5 base v2 gguf q4 k m
Base · keisuke-miyako
Params109M
Context512
Q4_K_M0.1 GB
GGUF
BA
S1 Base 32B
Base · StephenGenusa
Params32.8B
Context128K
Smallest22.6 GB
GGUF
BA
e5 base v2 Q8 0
Base · velyan
Params109M
Context512
Smallest0.1 GB
Embedding
BA
8b Base Academic 14 Q5 K M
Base · jaspionjader
Params8.03B
Context1024K
Smallest5.7 GB
GGUF
BA
3b_or_base
Base · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
GGUF
BA
Lazycuber L2 7b Base Guanaco Vicuna
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BA
e5 base v2 gguf f16
Base · keisuke-miyako
Params109M
Context512
Smallest0.2 GB
GGUF
BA
base 7B
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BA
S1 Base 32B
Base · lieren2023
Params32.8B
Context128K
Smallest34.8 GB
GGUF
BA
base_test_3_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
S1 Base 671B i1
Base · mradermacher
Params252M
Context—
Smallest1.0 GB
GGUF
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.1 GB
GGUF
BA
T5 Base
Base · andtt
Params223M
Context512
Smallest0.2 GB
GGUF
BA
e5 base v2 Q4 K M
Base · abhiraj1
Params109M
Context512
Q4_K_M0.1 GB
Embedding
BA
K2 V2 base final
Base · mesh-ops
Params72.6B
Context32K
Smallest51.5 GB
GGUF
BA
base_test_4_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
base_test_2_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
base_test_4_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
DM2 BASE2
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.3 GB
GGUF
BA
T5 Base
Base · egrhfnfdg
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
base_test_2_grpo_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
base_test_3_sft_gguf
Base · xlight05
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BA
S1 Base 32B
Base · jsfs11
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
BA
Base10
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
BA
T5 Base
Base · ArchaonX
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
J.O.S.I.E. 2x7B base
Base · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
BA
8b Base Academic 5 Q5 K M
Base · jaspionjader
Params8.03B
Context1024K
Smallest5.7 GB
GGUF
BA
T5 Base
Base · mrbutter
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
Base11
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use

Keep browsing