GGUF models by cstr

462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3.1 8b spaetzle v51 GGUF 1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CL
clip vit large patch14
Clip · cstr
Params304M
Context—
Smallest1.2 GB
GGUF
OC
occiglot 7b de en instruct
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
TR
trocr-base-printed
Trocr · cstr
Params385M
Context—
Smallest0.4 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
PH
phi 3 orpo v8 16
Phi · cstr
Params3.82B
Context4K
Smallest2.3 GB
GGUF
FR
marblenet-vad-multilingual-v2
Frame · cstr
Params—
Context—
Smallest0.0 GB
GGUF
OC
PP-OCRv6_small_det
Ocrv · cstr
Params2M
Context—
Smallest0.0 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · cstr
Params8.02B
Context32K
Q4_K_M4.9 GB
GGUF
MO
most embed de
Most · cstr
Params1.14B
Context—
Smallest0.9 GB
GGUF
LL
phi3 mini 4k llamafied sft v1
Llama · cstr
Params3.82B
Context4K
Smallest2.3 GB
GGUF
GR
granite speech 3.3 8b
Granite · cstr
Params8.85B
Context—
Smallest3.1 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
PI
pix2struct
Pix · cstr
Params282M
Context—
Smallest0.4 GB
GGUF
MO
moonshine-streaming-medium
Moonshine · cstr
Params266M
Context—
Smallest0.2 GB
GGUF
OV
h2ovl 800m crispembed
Ovl · cstr
Params826M
Context—
Smallest0.7 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
OL
olmOCR-2-7B-1025
OLMo · cstr
Params8.29B
Context—
Smallest5.7 GB
GGUF
PO
posformer mathwriting
Posformer · cstr
Params10M
Context—
Smallest0.0 GB
GGUF
GE
German-OCR-3.1
German · cstr
Params2.21B
Context—
Smallest1.7 GB
GGUF
OP
yunet
Opencv · cstr
Params—
Context—
Smallest0.0 GB
GGUF
OC
occiglot10b dpo
Occiglot · cstr
Params9.86B
Context32K
Smallest5.9 GB
GGUF
SP
Spaetzle v85 7b GGUF q4
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.1 GB
GGUF
JO
Josev 2B SystemOne
Josev · cstr
Params1.91B
Context—
Smallest7.7 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
SP
Spaetzle v31 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
LL
Llama3 DiscoLM German 8b v0.1 experimental
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
GGUF
MI
Mistral 7B base v0.2
Mistral · cstr
Params7.24B
Context16K
Smallest4.4 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
OC
Octen Embedding 0.6B
Octen · cstr
Params596M
Context—
Smallest0.3 GB
GGUF

Keep browsing