GGUF models by cstr

462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Starling LM 7B beta
Starling · cstr
Params7.24B
Context8K
Smallest4.4 GB
GGUF
AU
auraface v1
Auraface · cstr
Params65M
Context—
Smallest0.1 GB
GGUF
SP
Spaetzle v12 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
LA
mt0 large Q4 K M
Large · cstr
Params1.23B
Context512
Q4_K_M0.8 GB
GGUF
OM
OmniASR-CTC-1B
Omniasr · cstr
Params975M
Context—
Smallest0.6 GB
GGUF
MO
moonshine-streaming-small
Moonshine · cstr
Params140M
Context—
Smallest0.3 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
OC
PP-OCRv6_tiny_det
Ocrv · cstr
Params—
Context—
Smallest0.0 GB
GGUF
SP
Spaetzle v8 7b orpo2
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
TO
TowerInstruct 7B v0.2
Towerinstruct · cstr
Params6.74B
Context4K
Smallest4.1 GB
GGUF
PH
phi 3 orpo v9 16
Phi · cstr
Params3.82B
Context4K
Smallest2.3 GB
GGUF
AL
Spaetzle v69 7b
Alphamonarch · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
LL
llama3 8b spaetzle v33
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SI
siglip large 256
Siglip · cstr
Params316M
Context—
Smallest1.3 GB
GGUF
LA
ecapa lid commonlanguage
Lang · cstr
Params21M
Context—
Smallest0.0 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 1.5M CrispEmbed
Sauerkrautlm · cstr
Params1M
Context—
Smallest0.0 GB
GGUF
FL
Spaetzle v8 7b
Flora · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
LL
llama3 discolm orca
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
LL
llama3 8b spaetzle v31
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TR
trocr_small_printed_deit_perlayer
Trocr · cstr
Params61M
Context—
Smallest0.0 GB
GGUF
DI
DiscoLM German 7b v1 chat
Discolm · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
LL
Llama 3 SauerkrautLM 8b Instruct
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
GGUF
OC
occiglot 7b de en instruct dpo2
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
AL
Spaetzle v60 7b
Alphamonarch · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
XL
xlmr ner hrl
Xlm · cstr
Params277M
Context514
Smallest0.3 GB
GGUF
OC
occiglot 7b de en
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
TA
tada-encoder
Tada · cstr
Params447M
Context—
Smallest0.2 GB
GGUF

Keep browsing