Base GGUF models

127 GGUF models in the Base family, quantized by 43 uploaders. Sizes run from 37M to 105B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BA
99 v10 base
Base · mradermacher
Params99M
Context2K
Q4_K_M0.1 GB
GGUF
BA
Base Candidate 1 105B
Base · mradermacher
Params105B
Context128K
Smallest38.8 GB
Tool use
BA
base kontiki
Base · Civarchivist
Params11.9B
Context—
Smallest5.2 GB
GGUF
BA
base capacitor hist
Base · Civarchivist
Params11.9B
Context—
Smallest5.4 GB
GGUF
BA
base wan21
Base · JustAnotherCibrarian
Params16.4B
Context—
Smallest3.1 GB
GGUF
BA
base wan21 2509
Base · JustAnotherCibrarian
Params17.3B
Context—
Smallest12.6 GB
GGUF
BA
base minim3
Base · ThirdTimesTheCiarc
Params37M
Context—
Smallest0.1 GB
GGUF

Keep browsing