GGUF models by cstr
462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.
ST
Starling LM 7B beta
Starling · cstr
Params7.24B
Context8K
Smallest4.4 GB
AU
auraface v1
Auraface · cstr
Params65M
Context—
Smallest0.1 GB
SP
Spaetzle v12 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
LA
mt0 large Q4 K M
Large · cstr
Params1.23B
Context512
Q4_K_M0.8 GB
OM
OmniASR-CTC-1B
Omniasr · cstr
Params975M
Context—
Smallest0.6 GB
MO
moonshine-streaming-small
Moonshine · cstr
Params140M
Context—
Smallest0.3 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
OC
PP-OCRv6_tiny_det
Ocrv · cstr
Params—
Context—
Smallest0.0 GB
SP
Spaetzle v8 7b orpo2
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
TO
TowerInstruct 7B v0.2
Towerinstruct · cstr
Params6.74B
Context4K
Smallest4.1 GB
PH
phi 3 orpo v9 16
Phi · cstr
Params3.82B
Context4K
Smallest2.3 GB
AL
Spaetzle v69 7b
Alphamonarch · cstr
Params7.24B
Context32K
Smallest4.4 GB
LL
llama3 8b spaetzle v33
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
SI
siglip large 256
Siglip · cstr
Params316M
Context—
Smallest1.3 GB
LA
ecapa lid commonlanguage
Lang · cstr
Params21M
Context—
Smallest0.0 GB
SA
SauerkrautLM MoEdernColBERT 1.5M CrispEmbed
Sauerkrautlm · cstr
Params1M
Context—
Smallest0.0 GB
FL
Spaetzle v8 7b
Flora · cstr
Params7.24B
Context32K
Smallest4.4 GB
LL
llama3 discolm orca
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
LL
llama3 8b spaetzle v31
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
trocr_small_printed_deit_perlayer
Trocr · cstr
Params61M
Context—
Smallest0.0 GB
DI
DiscoLM German 7b v1 chat
Discolm · cstr
Params7.24B
Context32K
Smallest4.4 GB
LL
Llama 3 SauerkrautLM 8b Instruct
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
OC
occiglot 7b de en instruct dpo2
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
AL
Spaetzle v60 7b
Alphamonarch · cstr
Params7.24B
Context32K
Smallest4.4 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
XL
xlmr ner hrl
Xlm · cstr
Params277M
Context514
Smallest0.3 GB
OC
occiglot 7b de en
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
TA
tada-encoder
Tada · cstr
Params447M
Context—
Smallest0.2 GB