GGUF models by cstr

462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
SN
snowflake arctic embed m
Snowflake · cstr
Params109M
Context512
Smallest0.1 GB
Embedding
TR
trocr-small-handwritten
Trocr · cstr
Params61M
Context—
Smallest0.1 GB
GGUF
ET
ettin reranker 400m v1
Ettin · cstr
Params396M
Context—
Smallest0.3 GB
GGUF
GL
gliner deberta
Gliner · cstr
Params195M
Context—
Smallest0.2 GB
GGUF
DA
darwin tts 1.7b cross
Darwin · cstr
Params1.93B
Context—
Smallest1.1 GB
GGUF
OC
octen 4b
Octen · cstr
Params4.02B
Context40K
Smallest2.3 GB
Embedding
OV
ATH-MaaS/OvisOCR2
Ovisocr · cstr
Params853M
Context—
Smallest1.7 GB
GGUF
BI
bidirlm omni 2.5b textonly
Bidirlm · cstr
Params1.72B
Context125K
Smallest1.1 GB
Embedding
FI
firered ocr crispembed
Firered · cstr
Params2.13B
Context—
Smallest0.0 GB
GGUF
FA
sface
Face · cstr
Params10M
Context—
Smallest0.0 GB
GGUF
GR
granite speech 3.3 2b
Granite · cstr
Params3.11B
Context—
Smallest3.4 GB
GGUF
ET
ettin reranker 32m v1
Ettin · cstr
Params33M
Context—
Smallest0.0 GB
GGUF
SI
siglip so400m patch14 384
Siglip · cstr
Params428M
Context—
Smallest1.7 GB
GGUF
OC
octen 8b
Octen · cstr
Params7.57B
Context40K
Smallest4.4 GB
Embedding
OM
omniasr llm unlimited 300m v2
Omniasr · cstr
Params1.63B
Context—
Smallest1.1 GB
GGUF
LI
lightonocr crispembed
Lightonocr · cstr
Params1.01B
Context—
Smallest0.7 GB
GGUF
WA
wav2vec2 base 960h
Wav · cstr
Params94M
Context—
Smallest0.2 GB
GGUF
QW
Uni-MuMER-Qwen2.5-VL-3B
Qwen · cstr
Params4.07B
Context—
Smallest3.0 GB
GGUF
TE
tesseract frk
Tesseract · cstr
Params2M
Context—
Smallest0.0 GB
GGUF
UL
UltraBERT-Embed-150M
Ultrabert · cstr
Params151M
Context32K
Smallest0.6 GB
Embedding
LL
Phi 3 mini 4k instruct LLaMAfied
Llama · cstr
Params3.82B
Context4K
Smallest2.3 GB
GGUF
GT
gte small
Gte · cstr
Params33M
Context512
Smallest0.0 GB
Embedding
YI
Yi 1.5 9B Chat
Yi · cstr
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
AY
Aya Expanse 8b
Aya · cstr
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
ET
ettin reranker 17m v1
Ettin · cstr
Params17M
Context—
Smallest0.0 GB
GGUF
GR
granite speech 3.2 8b
Granite · cstr
Params8.68B
Context—
Smallest3.0 GB
GGUF
PA
parakeet unified en 0.6b
Parakeet · cstr
Params618M
Context—
Smallest0.4 GB
GGUF
PU
punctuate all
Punctuate · cstr
Params277M
Context—
Smallest0.2 GB
GGUF
LL
Llama3 DiscoLeo Instruct 8B v0.1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SP
splade v3
Splade · cstr
Params110M
Context—
Smallest0.1 GB
GGUF

Keep browsing