GGUF models by cstr

462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
f2llm v2 160m
Llm · cstr
Params159M
Context—
Smallest0.1 GB
GGUF
SP
splade pp en v1
Splade · cstr
Params110M
Context—
Smallest0.1 GB
GGUF
SM
SmolDocling-256M-preview
Smoldocling · cstr
Params256M
Context—
Smallest0.2 GB
GGUF
SN
snowflake arctic embed l
Snowflake · cstr
Params334M
Context512
Smallest0.2 GB
Embedding
SA
SauerkrautLM MoEdernColBERT 27M CrispEmbed
Sauerkrautlm · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
ET
ettin reranker 68m v1
Ettin · cstr
Params69M
Context—
Smallest0.1 GB
GGUF
BG
bge small en v1.5
BGE · cstr
Params33M
Context512
Smallest0.0 GB
Embedding
PO
posformer hw
Posformer · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
ST
stt en fastconformer ctc xxlarge
Stt · cstr
Params1.06B
Context—
Smallest0.7 GB
GGUF
SA
SAM 2.1 Hiera-tiny (image mode)
Sam · cstr
Params31M
Context—
Smallest0.1 GB
GGUF
FO
texo distill
Formulanet · cstr
Params20M
Context—
Smallest0.0 GB
GGUF
QA
qari ocr crispembed
Qari · cstr
Params2.21B
Context—
Smallest0.0 GB
GGUF
GT
gte base en v1.5
Gte · cstr
Params137M
Context8K
Smallest0.1 GB
Embedding
SP
Spaetzle v85 7b
Spaetzle · cstr
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SN
arctic embed xs
Snowflake · cstr
Params23M
Context512
Smallest0.0 GB
Embedding
SU
surya det
Surya · cstr
Params38M
Context—
Smallest0.0 GB
GGUF
HA
harrier 0.6b
Harrier · cstr
Params596M
Context32K
Smallest0.4 GB
Embedding
SM
smt fp grandstaff
Smt · cstr
Params12M
Context—
Smallest0.0 GB
GGUF
TR
TrOCR Math Handwritten (AFL-3.0)
Trocr · cstr
Params609M
Context—
Smallest0.4 GB
GGUF
LI
lilt funsd
Lilt · cstr
Params130M
Context—
Smallest0.1 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 115M CrispEmbed
Sauerkrautlm · cstr
Params115M
Context—
Smallest0.1 GB
GGUF
BG
bge large en v1.5
BGE · cstr
Params334M
Context512
Smallest0.2 GB
Embedding
IN
InternVL2_5-2B
Internvl · cstr
Params2.21B
Context—
Smallest1.5 GB
GGUF
CL
clip text large
Clip · cstr
Params124M
Context—
Smallest0.1 GB
GGUF
JI
jina-ocr-v1
Jina · cstr
Params3.34B
Context—
Smallest2.3 GB
GGUF
PA
paddleocr vl 1.6
Paddleocr · cstr
Params943M
Context—
Smallest1.3 GB
GGUF
ET
ettin reranker 1b v1
Ettin · cstr
Params1.03B
Context—
Smallest0.6 GB
GGUF
AL
all MiniLM L12 v2
All · cstr
Params33M
Context—
Smallest0.0 GB
GGUF
PA
parakeet de med
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
AL
all mpnet base v2
All · cstr
Params109M
Context514
Smallest0.1 GB
Embedding

Keep browsing