Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 12B it qat jacobian lens
Gemma · gghfez
Params693M
Context—
Smallest1.4 GB
GGUF
QW
Qwen3.5 2B Focused Honest
Qwen · AmaLS367
Params1.88B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · bakhtin
Params27.3B
Context256K
Smallest17.1 GB
GGUF
QW
Qwen3.5 9B Writing DPO
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
FO
foq reflex 8b
Foq · Yoedi
Params15M
Context—
Smallest0.1 GB
GGUF
TR
trocr-small-handwritten
Trocr · cstr
Params61M
Context—
Smallest0.1 GB
GGUF
BI
bigasp3
Bigasp · dontlikeglowies
Params9.08B
Context—
Smallest5.1 GB
GGUF
MI
MiniCPM5 2B Super Lora
MiniCPM · bunnycore
Params50M
Context—
Smallest0.1 GB
GGUF
LL
Code Summary Llama 3.2 3B Instruct
Llama · bestler
Params3.21B
Context128K
Smallest6.4 GB
GGUF
NO
novaFurryXL ilV160
Novafurryxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
YI
yiffymix v62Noobxl
Yiffymix · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
SP
Spark X2.5 4B ASHQ1
Spark · wepiqx
Params4.11B
Context1024K
Smallest0.0 GB
GGUF
GE
shukatsu gemma4
Gemma · careerbot
Params25.2B
Context256K
Smallest0.6 GB
GGUF
ET
ettin reranker 400m v1
Ettin · cstr
Params396M
Context—
Smallest0.3 GB
GGUF
IM
sd image generate models
Image · j5ng
Params6.15B
Context—
Smallest7.2 GB
GGUF
QW
Qwen3.5 397B A17B heretic GGUF v2 MTP
Qwen · dxx117
Params403B
Context256K
Q4_K_M245.6 GB
GGUF
HY
Hy3
batiai
Params295B
Context256K
Q4_K_M178.6 GB
GGUF
IM
z image model
Image · Kerstal
Params6.15B
Context—
Smallest6.5 GB
GGUF
QW
Narae1 Qwen3 0.6B SFT v1
Qwen · inhow
Params600M
Context—
Smallest0.0 GB
GGUF
QW
Narae3 Qwen3 4B LoRA v1
Qwen · inhow
Params3M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · ivp5
Params—
Context—
Smallest23.3 GB
GGUF
QW
Qwen3.5 27B heretic v2 IQ4 XS
Qwen · nesymerp1
Params26.9B
Context256K
Smallest0.0 GB
GGUF
TI
TinyLlama 1.1B intermediate step 480k 1T
Tinyllama · Trelis
Params1.1B
Context2K
Smallest0.0 GB
GGUF
PO
polyx
Polyx · 75dhsx
Params8.9B
Context—
Smallest9.5 GB
GGUF
GL
gliner deberta
Gliner · cstr
Params195M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash IQ2XXS TM64 Q4KAttention v1
DeepSeek · erayyapagci
Params284B
Context1024K
Smallest10.6 GB
GGUF
GE
gemma 4 12B it qat matura history sft vision qlora r32
Gemma · WMTH-100d2exam
Params131M
Context—
Smallest0.3 GB
GGUF
FA
Falconsai/Athr_Agent_Sec/model.safetensors
Falcon · Falconsai
Params—
Context—
Smallest0.0 GB
GGUF
QW
dxx117 Qwen3.5 397B A17B heretic GGUF v2 MTP
Qwen · fesfes1
Params403B
Context256K
Q4_K_M245.6 GB
GGUF
JA
jackrabbit 110m ro handy
Jackrabbit · jonah1024
Params115M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing