GGUF models by cstr
462 GGUF models quantized by cstr on Hugging Face. Sizes run from 1M to 10.7B parameters. The longest trained context is 128K tokens.
LL
llama3.1 8b spaetzle v51 GGUF 1
Llama · cstr
Params8.03B
Context8K
Q4_K_M4.9 GB
CL
clip vit large patch14
Clip · cstr
Params304M
Context—
Smallest1.2 GB
OC
occiglot 7b de en instruct
Occiglot · cstr
Params7.24B
Context32K
Smallest4.4 GB
TR
trocr-base-printed
Trocr · cstr
Params385M
Context—
Smallest0.4 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
PH
phi 3 orpo v8 16
Phi · cstr
Params3.82B
Context4K
Smallest2.3 GB
FR
marblenet-vad-multilingual-v2
Frame · cstr
Params—
Context—
Smallest0.0 GB
OC
PP-OCRv6_small_det
Ocrv · cstr
Params2M
Context—
Smallest0.0 GB
MI
Ministral 8B Instruct 2410
Mistral · cstr
Params8.02B
Context32K
Q4_K_M4.9 GB
MO
most embed de
Most · cstr
Params1.14B
Context—
Smallest0.9 GB
LL
phi3 mini 4k llamafied sft v1
Llama · cstr
Params3.82B
Context4K
Smallest2.3 GB
GR
granite speech 3.3 8b
Granite · cstr
Params8.85B
Context—
Smallest3.1 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
PI
pix2struct
Pix · cstr
Params282M
Context—
Smallest0.4 GB
MO
moonshine-streaming-medium
Moonshine · cstr
Params266M
Context—
Smallest0.2 GB
OV
h2ovl 800m crispembed
Ovl · cstr
Params826M
Context—
Smallest0.7 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
OL
olmOCR-2-7B-1025
OLMo · cstr
Params8.29B
Context—
Smallest5.7 GB
PO
posformer mathwriting
Posformer · cstr
Params10M
Context—
Smallest0.0 GB
GE
German-OCR-3.1
German · cstr
Params2.21B
Context—
Smallest1.7 GB
OP
yunet
Opencv · cstr
Params—
Context—
Smallest0.0 GB
OC
occiglot10b dpo
Occiglot · cstr
Params9.86B
Context32K
Smallest5.9 GB
SP
Spaetzle v85 7b GGUF q4
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.1 GB
JO
Josev 2B SystemOne
Josev · cstr
Params1.91B
Context—
Smallest7.7 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
SP
Spaetzle v31 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
LL
Llama3 DiscoLM German 8b v0.1 experimental
Llama · cstr
Params8.03B
Context8K
Smallest4.9 GB
MI
Mistral 7B base v0.2
Mistral · cstr
Params7.24B
Context16K
Smallest4.4 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
OC
Octen Embedding 0.6B
Octen · cstr
Params596M
Context—
Smallest0.3 GB