GGUF models by abarelka

35 GGUF models quantized by abarelka on Hugging Face. Sizes run from 8.03B to 8.03B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
L318B Q8 0 STonly
Llama · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AL
L318B Q8 0 ST7 all OCMs
All · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
model Q8 0 UST all5USL SL
Llama · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
model 16bitgguf ST
Llama · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
model Q8 0 UST all5USL SL 2
Llama · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
L318B Q8 0 UST1102 ST7OCM
Llama · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AL
L318B Q8 0 allCFETPsandOCMs B4 EOSatendofdocs
Allcfetpsandocms · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
L318B 16bitGGUF UST ST
Llama · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
AL
L318B Q8 0 allOCMsandCFETPs EOSatendofdocs
Allocmsandcfetps · abarelka
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BI
L318B 16bit Unstru ST7OCM UST1102
Bit · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
AL
L318B Q8 0 allCFETPsandOCMs B3 EOSatendofdocs
Allcfetpsandocms · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AL
L318B Q8 0 allOCMsandCFETPs B6 EOSatendofdocs
Allocmsandcfetps · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AL
L318B Q8 0 allCFETPs allOCMs
Allcfetps · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
L318B 16bitGGUF ST UST
Llama · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
AL
L318B Q8 0 allCFETPsandOCMs B5 EOSatendofdocs
Allcfetpsandocms · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
UN
L318B Q8 0 Unstru ST7OCM UST1102
Unstru · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
AL
L318B Q8 0 allCFETPs EOSatendofdocs
Allcfetps · abarelka
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BI
L318B 16bitGGUF allOCMsandCFETPs EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
GGUF
BI
L318B 16bitGGUF allCFETPsandOCMs B4 EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
BI
L318B 16bitGGUF allCFETPsandOCMs B5 EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
BI
L318B 16bitGGUF allCFETPsandOCMs B3 EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
AL
L318B Q8 0 allCFETPsandOCMs EOSatendofdocs
Allcfetpsandocms · abarelka
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BI
L318B 16bitGGUF allCFETPs allOCMs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
AL
L318B Q8 0 allCFETPs
Allcfetps · abarelka
Params8.03B
Context128K
Smallest8.5 GB
GGUF
BI
L318B 16bitGGUF allCFETPs EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
GGUF
BI
L318B 16bitGGUF allCFETPs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
GGUF
BI
L318B 16bitGGUF allOCMsandCFETPs B6 EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
Tool use
UN
L318B Q8 0 Unstru UST1102 ST7OCM
Unstru · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use
BI
L318B 16bitGGUF allCFETPsandOCMs EOSatendofdocs
Bitgguf · abarelka
Params8.03B
Context128K
Smallest16.1 GB
GGUF
US
L318B Q8 0 ST UST B7
Ust · abarelka
Params8.03B
Context128K
Smallest8.5 GB
Tool use

About abarelka on Hugging Face

abarelka has published 35 GGUF models that ggufmodels.com tracks, across families such as Bitgguf, Llama and Allcfetpsandocms. The most downloaded are L318B Q8 0 STonly, L318B Q8 0 ST7 all OCMs and model Q8 0 UST all5USL SL.

The quants abarelka publishes most often are Q8_0 (18) and F16 (17). Parameter counts run from 8.03B to 8.03B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has abarelka published?

35 models are listed here, mainly from the Bitgguf, Llama and Allcfetpsandocms families. The most downloaded is L318B Q8 0 STonly.

Which quants does abarelka publish?

The most common are Q8_0 (18 models) and F16 (17 models).

Keep browsing