Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OC
octo-small-so101-multi-task
Octo · khanhnd61
Params137M
Context—
Smallest0.5 GB
GGUF
OL
olmOCR-2-7B-1025
OLMo · cstr
Params8.29B
Context—
Smallest5.7 GB
GGUF
VO
VoxCPM2 gguf notcpp
Voxcpm · smthem
Params2.29B
Context—
Smallest2.1 GB
GGUF
QA
qamqorai files
Qamqorai · mrfukk7
Params8B
Context—
Smallest0.0 GB
GGUF
IA
IAmCat chat LoRA
Iamcat · nukonukomain
Params40M
Context—
Smallest0.1 GB
GGUF
CO
codegemma 1.1 2b
Codegemma · olegshulyakov
Params2.51B
Context8K
Smallest0.0 GB
GGUF
BA
bark
Bark · vokra
Params1.12B
Context—
Smallest4.5 GB
GGUF
MO
model vault
Model · HentaiP
Params12.8B
Context—
Q4_K_M7.2 GB
GGUF
TE
ternary bonsai 4b decision lora
Ternary · ChezRD
Params132M
Context—
Smallest0.1 GB
GGUF
GP
Huihui gpt oss 120b mxfp4 abliterated i1
gpt-oss · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
LI
lightonai/Agent-ModernColBERT
Lightonai · johannhartmann
Params149M
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.8 27B Fable Distill LoRA
Qwen · saifvj
Params233M
Context—
Smallest0.5 GB
GGUF
BR
Breeze 7B FC v1 0 EvolKit 75K Nopm_Claude_Writing_Fixed Adapter
Breeze · win10
Params21M
Context—
Smallest0.1 GB
GGUF
KR
Krea2 checkpoints
Krea · blyat1
Params12.8B
Context—
Smallest14.6 GB
GGUF
PO
posformer mathwriting
Posformer · cstr
Params10M
Context—
Smallest0.0 GB
GGUF
GE
gemma4 26b opus lora
Gemma · hotdogs
Params9M
Context—
Smallest0.0 GB
GGUF
DE
R2 DeepSeek V4 Flash 0731 TQ3 4S
DeepSeek · YTan2000
Params284B
Context1024K
Smallest97.0 GB
GGUF
GE
German-OCR-3.1
German · cstr
Params2.21B
Context—
Smallest1.7 GB
GGUF
AV
Avero 1B Text
Avero · AveroLabs
Params1B
Context—
Smallest2.6 GB
GGUF
HE
hemmingway tot lora
Hemmingway · hotdogs
Params109M
Context—
Smallest0.2 GB
GGUF
ST
stories15M bf16
Stories · halflucifer
Params24M
Context128
Smallest0.0 GB
GGUF
GR
grok 2 i1
Grok · mradermacher
Params23M
Context—
Smallest0.1 GB
GGUF
GE
Equinox gemma 4 31B GGUF 5.05BPW
Gemma · Beinsezii
Params30.7B
Context256K
Smallest0.0 GB
GGUF
QW
Jinx Qwen3 30B A3B Thinking 2507
Qwen · marcelone
Params30.5B
Context256K
Smallest0.1 GB
GGUF
OP
yunet
Opencv · cstr
Params—
Context—
Smallest0.0 GB
GGUF
BI
BiRefNet_lite
Birefnet · gfaccipo
Params220M
Context—
Smallest0.1 GB
GGUF
QW
crisisgraph qwen3 4b triage lora v3
Qwen · antonyamal071
Params33M
Context—
Smallest0.1 GB
GGUF
OR
orca mini 3B
Orca · zoltanctoth
Params3.43B
Context—
Smallest1.9 GB
GGUF
NS
NSFW 22 L e8
Nsfw · sara-ai-01
Params14.3B
Context—
Smallest10.8 GB
GGUF
GR
gr00tn1d5 libero object
vrfai
Params2.4B
Context—
Smallest6.9 GB
GGUF

Other uses

Keep browsing