GGUF models by cstr
462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.
SN
snowflake arctic embed m
Snowflake · cstr
Params109M
Context512
Smallest0.1 GB
TR
trocr-small-handwritten
Trocr · cstr
Params61M
Context—
Smallest0.1 GB
ET
ettin reranker 400m v1
Ettin · cstr
Params396M
Context—
Smallest0.3 GB
GL
gliner deberta
Gliner · cstr
Params195M
Context—
Smallest0.2 GB
DA
darwin tts 1.7b cross
Darwin · cstr
Params1.93B
Context—
Smallest1.1 GB
OC
octen 4b
Octen · cstr
Params4.02B
Context40K
Smallest2.3 GB
OV
ATH-MaaS/OvisOCR2
Ovisocr · cstr
Params853M
Context—
Smallest1.7 GB
BI
bidirlm omni 2.5b textonly
Bidirlm · cstr
Params1.72B
Context125K
Smallest1.1 GB
FI
firered ocr crispembed
Firered · cstr
Params2.13B
Context—
Smallest0.0 GB
FA
sface
Face · cstr
Params10M
Context—
Smallest0.0 GB
GR
granite speech 3.3 2b
Granite · cstr
Params3.11B
Context—
Smallest3.4 GB
ET
ettin reranker 32m v1
Ettin · cstr
Params33M
Context—
Smallest0.0 GB
SI
siglip so400m patch14 384
Siglip · cstr
Params428M
Context—
Smallest1.7 GB
OC
octen 8b
Octen · cstr
Params7.57B
Context40K
Smallest4.4 GB
OM
omniasr llm unlimited 300m v2
Omniasr · cstr
Params1.63B
Context—
Smallest1.1 GB
LI
lightonocr crispembed
Lightonocr · cstr
Params1.01B
Context—
Smallest0.7 GB
WA
wav2vec2 base 960h
Wav · cstr
Params94M
Context—
Smallest0.2 GB
QW
Uni-MuMER-Qwen2.5-VL-3B
Qwen · cstr
Params4.07B
Context—
Smallest3.0 GB
TE
tesseract frk
Tesseract · cstr
Params2M
Context—
Smallest0.0 GB
UL
UltraBERT-Embed-150M
Ultrabert · cstr
Params151M
Context32K
Smallest0.6 GB
LL
Phi 3 mini 4k instruct LLaMAfied
Llama · cstr
Params3.82B
Context4K
Smallest2.3 GB
GT
gte small
Gte · cstr
Params33M
Context512
Smallest0.0 GB
YI
Yi 1.5 9B Chat
Yi · cstr
Params8.83B
Context4K
Q4_K_M5.3 GB
AY
Aya Expanse 8b
Aya · cstr
Params8.03B
Context8K
Q4_K_M5.1 GB
ET
ettin reranker 17m v1
Ettin · cstr
Params17M
Context—
Smallest0.0 GB
GR
granite speech 3.2 8b
Granite · cstr
Params8.68B
Context—
Smallest3.0 GB
PA
parakeet unified en 0.6b
Parakeet · cstr
Params618M
Context—
Smallest0.4 GB
PU
punctuate all
Punctuate · cstr
Params277M
Context—
Smallest0.2 GB
LL
Llama3 DiscoLeo Instruct 8B v0.1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
SP
splade v3
Splade · cstr
Params110M
Context—
Smallest0.1 GB