Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Coder 1.5B
Qwen · olegshulyakov
Params1.54B
Context32K
Smallest0.0 GB
BI
BitDance 14B 64x merge
Bitdance · smthem
Params14.8B
Context—
Smallest17.2 GB
PY
pyannote speaker diarization 3.1
Pyannote · vokra
Params—
Context—
Smallest0.0 GB
QW
typst autocomplete lora
Qwen · zh1124
Params40M
Context—
Smallest0.1 GB
DI
dinov2 large
Dinov · dinov2-cpp-core
Params306M
Context—
Smallest0.6 GB
QW
Qwen3 VL 235B A22B Thinking i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
QW
competence gate qwen3.5 4b
Qwen · synthiumjp
Params5M
Context—
Smallest0.0 GB
QW
sqlCoder Qwen2.5 8bit
Qwen · shaikehsan
Params69M
Context—
Smallest0.3 GB
SM
SmolLM3 3B magic1 Q6 K
SmolLM · TobDeBer
Params3.08B
Context64K
Smallest0.4 GB
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · janchk
Params88M
Context—
Smallest0.4 GB
NE
nemo nano codec 22khz 1.89kbps 21.5fps
Nemo · TechnoBaptist
Params39M
Context—
Smallest0.1 GB
HU
HunyuanImage
Hunyuanimage · svjack
Params17.4B
Context—
Smallest0.4 GB
QW
qwen2vl vision
Qwen · LiuHao03322
Params665M
Context—
Smallest2.7 GB
SM
smolvla libero bf16
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
RE
ReviewAnalyzer5Epoch
Reviewanalyzer · Humayoun
Params30M
Context—
Smallest0.1 GB
GE
ngager email gemma4 4b
Gemma · minkyboba
Params7.46B
Context128K
Smallest0.0 GB
LI
ActQuant Pi05 LIBERO 3.5bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.5 GB
DE
DeepSeek V4 Flash custom iq3down
DeepSeek · starvingcheetah
Params284B
Context1024K
Smallest91.6 GB
GE
gemma 4 e4b it qcache q8
Gemma · DeepDavid
Params4.64B
Context—
Smallest4.9 GB
SH
ShareModel
Sharemodel · ZHYG
Params—
Context—
Smallest1.3 GB
QW
insightsql qwen3 8b lora F16
Qwen · LineLuLan
Params44M
Context—
Smallest0.1 GB
PO
poc evil big be
Poc · lilin34523
Params—
Context—
Smallest0.0 GB
QW
QwQ 32B Preview with Tags LoRA
Qwen · shakedzy
Params134M
Context—
Q4_K_M0.5 GB
SM
SmolLM2 1.7B Instruct Q4 K M BE
SmolLM · librepowerai
Params1.71B
Context8K
Q4_K_M1.1 GB
KR
Krea2 Checkpoints
Krea · gacekmg
Params—
Context—
Smallest14.6 GB
HA
harrier
Harrier · appvoid
Params268M
Context—
Smallest0.2 GB
SU
Wn22
Supbatomic · Supbatomic
Params14.3B
Context—
Smallest8.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B Q4 K M BE
DeepSeek · librepowerai
Params1.78B
Context128K
Q4_K_M1.1 GB
YU
l2 7b yuri ddlc v0.1
Yuri · 922-CA
Params6.74B
Context2K
Smallest5.1 GB
QW
Qwen2.5 7B Exp2 Lora_Model
Qwen · bunnycore
Params40M
Context—
Smallest0.2 GB