Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B
Qwen · olegshulyakov
Params1.54B
Context32K
Smallest0.0 GB
GGUF
BI
BitDance 14B 64x merge
Bitdance · smthem
Params14.8B
Context—
Smallest17.2 GB
GGUF
PY
pyannote speaker diarization 3.1
Pyannote · vokra
Params—
Context—
Smallest0.0 GB
GGUF
QW
typst autocomplete lora
Qwen · zh1124
Params40M
Context—
Smallest0.1 GB
GGUF
DI
dinov2 large
Dinov · dinov2-cpp-core
Params306M
Context—
Smallest0.6 GB
GGUF
QW
Qwen3 VL 235B A22B Thinking i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
GGUF
QW
competence gate qwen3.5 4b
Qwen · synthiumjp
Params5M
Context—
Smallest0.0 GB
GGUF
QW
sqlCoder Qwen2.5 8bit
Qwen · shaikehsan
Params69M
Context—
Smallest0.3 GB
GGUF
SM
SmolLM3 3B magic1 Q6 K
SmolLM · TobDeBer
Params3.08B
Context64K
Smallest0.4 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · janchk
Params88M
Context—
Smallest0.4 GB
GGUF
NE
nemo nano codec 22khz 1.89kbps 21.5fps
Nemo · TechnoBaptist
Params39M
Context—
Smallest0.1 GB
GGUF
HU
HunyuanImage
Hunyuanimage · svjack
Params17.4B
Context—
Smallest0.4 GB
GGUF
QW
qwen2vl vision
Qwen · LiuHao03322
Params665M
Context—
Smallest2.7 GB
GGUF
SM
smolvla libero bf16
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
GGUF
RE
ReviewAnalyzer5Epoch
Reviewanalyzer · Humayoun
Params30M
Context—
Smallest0.1 GB
GGUF
GE
ngager email gemma4 4b
Gemma · minkyboba
Params7.46B
Context128K
Smallest0.0 GB
GGUF
LI
ActQuant Pi05 LIBERO 3.5bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.5 GB
GGUF
DE
DeepSeek V4 Flash custom iq3down
DeepSeek · starvingcheetah
Params284B
Context1024K
Smallest91.6 GB
GGUF
GE
gemma 4 e4b it qcache q8
Gemma · DeepDavid
Params4.64B
Context—
Smallest4.9 GB
GGUF
SH
ShareModel
Sharemodel · ZHYG
Params—
Context—
Smallest1.3 GB
GGUF
QW
insightsql qwen3 8b lora F16
Qwen · LineLuLan
Params44M
Context—
Smallest0.1 GB
GGUF
PO
poc evil big be
Poc · lilin34523
Params—
Context—
Smallest0.0 GB
GGUF
QW
QwQ 32B Preview with Tags LoRA
Qwen · shakedzy
Params134M
Context—
Q4_K_M0.5 GB
GGUF
SM
SmolLM2 1.7B Instruct Q4 K M BE
SmolLM · librepowerai
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
KR
Krea2 Checkpoints
Krea · gacekmg
Params—
Context—
Smallest14.6 GB
GGUF
HA
harrier
Harrier · appvoid
Params268M
Context—
Smallest0.2 GB
GGUF
SU
Wn22
Supbatomic · Supbatomic
Params14.3B
Context—
Smallest8.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Q4 K M BE
DeepSeek · librepowerai
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
YU
l2 7b yuri ddlc v0.1
Yuri · 922-CA
Params6.74B
Context2K
Smallest5.1 GB
GGUF
QW
Qwen2.5 7B Exp2 Lora_Model
Qwen · bunnycore
Params40M
Context—
Smallest0.2 GB
GGUF

Other uses

Keep browsing