Base GGUF models
127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.
BA
UL3.3 X90 BASE 70B
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
BA
base dark 2
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
BA
base light 3
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
BA
8b Base SzilvaB 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
BA
LS2.5 108M A17M Chat
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
BA
8b Base ResplendentAI 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
BA
8b Base Academic 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
BA
rlx vlash
Base · eugenehp
Params3.24B
Context—
Smallest1.8 GB
BA
LS2.5 108M A17M Base
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
BA
8b Base StoryGen 1
Base · mradermacher
Params7.24B
Context1024K
Q4_K_M4.4 GB
BA
Cyberbabooshka Base_Noreasoning
Base · tensorblock
Params596M
Context32K
Smallest0.3 GB
BA
ms3 base roselily Q6 K
Base · WesPro
Params23.6B
Context32K
Smallest19.3 GB
BA
8b Base mixed 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
BA
J.O.S.I.E. 2x7B base i1
Base · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
BA
S1 Base 8B
Base · StephenGenusa
Params8.19B
Context40K
Smallest8.7 GB
BA
Deval Core Base Eval
Base · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
BA
pk_sft_v1
Base · johnnyteutonic
Params110M
Context512
Smallest0.4 GB
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Q4_K_M0.2 GB
BA
base 040125
Base · shamsherhaider
Params8.03B
Context128K
Smallest8.5 GB
BA
T5 Base
Base · mrbutter
Params223M
Context512
Smallest0.1 GB
BA
Base Candidate 2 105B
Base · mradermacher
Params105B
Context128K
Smallest38.8 GB
BA
base-7b-v0.2
Base · internistai
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
S1 Base 32B
Base · StephenGenusa
Params32.8B
Context128K
Smallest18.6 GB
BA
T5 Base Summarization Claim Extractor
Base · americansquid
Params223M
Context512
Q4_K_M0.1 GB
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.2 GB
BA
1.5b Base Sokoban Sfted Wza
Base · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
BA
S1 Base 32B
Base · sizzlebop
Params32.8B
Context128K
Smallest34.8 GB
BA
T5 V1_1 Base
Base · ysn-rfd
Params248M
Context512
Smallest0.3 GB
BA
e5 base v2 gguf q8 0
Base · keisuke-miyako
Params109M
Context512
Smallest0.1 GB
BA
t5 base Q4 K M
Base · jorismathijssen
Params223M
Context512
Q4_K_M0.1 GB