Base GGUF models

127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
UL3.3 X90 BASE 70B
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BA
base dark 2
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BA
base light 3
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BA
8b Base SzilvaB 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
BA
LS2.5 108M A17M Chat
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
GGUF
BA
8b Base ResplendentAI 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
BA
8b Base Academic 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
BA
rlx vlash
Base · eugenehp
Params3.24B
Context—
Smallest1.8 GB
GGUF
BA
LS2.5 108M A17M Base
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
GGUF
BA
8b Base StoryGen 1
Base · mradermacher
Params7.24B
Context1024K
Q4_K_M4.4 GB
GGUF
BA
Cyberbabooshka Base_Noreasoning
Base · tensorblock
Params596M
Context32K
Smallest0.3 GB
Reasoning
BA
ms3 base roselily Q6 K
Base · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
BA
8b Base mixed 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
BA
J.O.S.I.E. 2x7B base i1
Base · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
BA
S1 Base 8B
Base · StephenGenusa
Params8.19B
Context40K
Smallest8.7 GB
GGUF
BA
Deval Core Base Eval
Base · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
BA
pk_sft_v1
Base · johnnyteutonic
Params110M
Context512
Smallest0.4 GB
GGUF
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Q4_K_M0.2 GB
GGUF
BA
base 040125
Base · shamsherhaider
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BA
T5 Base
Base · mrbutter
Params223M
Context512
Smallest0.1 GB
GGUF
BA
Base Candidate 2 105B
Base · mradermacher
Params105B
Context128K
Smallest38.8 GB
Tool use
BA
base-7b-v0.2
Base · internistai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
S1 Base 32B
Base · StephenGenusa
Params32.8B
Context128K
Smallest18.6 GB
GGUF
BA
T5 Base Summarization Claim Extractor
Base · americansquid
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
T5 V1_1 Base
Base · jukkim046
Params248M
Context512
Smallest0.2 GB
GGUF
BA
1.5b Base Sokoban Sfted Wza
Base · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
BA
S1 Base 32B
Base · sizzlebop
Params32.8B
Context128K
Smallest34.8 GB
GGUF
BA
T5 V1_1 Base
Base · ysn-rfd
Params248M
Context512
Smallest0.3 GB
GGUF
BA
e5 base v2 gguf q8 0
Base · keisuke-miyako
Params109M
Context512
Smallest0.1 GB
GGUF
BA
t5 base Q4 K M
Base · jorismathijssen
Params223M
Context512
Q4_K_M0.1 GB
GGUF

Keep browsing