Base GGUF models

127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
t5 base summarization claim extractor
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
UL3.3 X90 BASE 70B i1
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BA
m3e base i1
Base · mradermacher
Params102M
Context512
Q4_K_M0.1 GB
Embedding
BA
T5 Base Japanese
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
t5 base grammar checker
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
BASE 1.5B
Base · Stray2024
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
BA
deval-core/base-eval
Base · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BA
S1 Base 8B
Base · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
BA
3B Base
Base · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
BA
base dark 2 i1
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BA
LTC AI Labs L2 7b Base WVG Uncensored
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
BA
Base Stories 8b
Base · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BA
base light 3 i1
Base · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BA
T5 Base
Base · Felladrin
Params248M
Context512
Smallest0.2 GB
GGUF
BA
8b Base Tier2 1
Base · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
BA
L BASE EXPERMIENTAL THINKER V1A
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
BA
T5 Base English Japanese
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
BA
pk_base_v1
Base · johnnyteutonic
Params110M
Context512
Q4_K_M0.1 GB
GGUF
BA
S1 Base 1.5 8B 128K
Base · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
BA
DM1 BASE2
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
BA
MN 2407 Base ChatML Zeroed Interleaved 17.7B
Base · mradermacher
Params17.7B
Context128K
Q4_K_M10.7 GB
GGUF
BA
Nytopop 1b_or_base
Base · tensorblock
Params1.29B
Context128K
Smallest0.6 GB
GGUF
BA
Mt5 Base Parsinlu Translation_En_Fa
Base · MichaelJ2026
Params582M
Context512
Q4_K_M0.4 GB
GGUF
BA
S1 Base 1.5 8B 128K
Base · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
BA
COPAL
Base · balastml
Params223M
Context512
Q4_K_M0.1 GB
GGUF
BA
Base ollama
Base · ressurectAI
Params8.03B
Context128K
Smallest16.1 GB
GGUF
BA
LS2.5 108M A17M Coder
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
GGUF
BA
T5 Base Japanese v1.1
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
BA
Mt5 Base
Base · MichaelJ2026
Params582M
Context512
Q4_K_M0.4 GB
GGUF
BA
UL3.3 X BASE 70B
Base · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing