Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct v0.3 QLoRA Legal
Mistral · Sleem247
Params2M
Context—
Smallest0.0 GB
GGUF
RE
rebar-heading-classifier
Rebar · NagaYu
Params—
Context—
Smallest0.0 GB
GGUF
QW
dxa lm
Qwen · deployxa
Params—
Context—
Q4_K_M0.0 GB
GGUF
IM
Z Image Turbo
Image · biali
Params6.15B
Context—
Smallest3.1 GB
GGUF
CA
candle quantized LaMini Flan T5 248M
Candle · Felladrin
Params248M
Context—
Smallest0.1 GB
GGUF
QW
lexwell-contract-irac-qwen2.5-3b-lora
Qwen · Sleem247
Params7M
Context—
Smallest0.0 GB
GGUF
CO
Cotype Nano Generate Adapter
Cotype · vkimbris
Params19M
Context—
Smallest0.1 GB
GGUF
QW
librarian curator qwen35 9b grooming
Qwen · code-ministry-ltd
Params15M
Context—
Smallest0.0 GB
GGUF
FA
distilbert/distilgpt2/model.safetensors
Falcon · Falconsai
Params88M
Context—
Smallest0.4 GB
GGUF
QW
sydney qwen3.5 4b lora f16
Qwen · zhxs502
Params33M
Context—
Smallest0.1 GB
GGUF
LF
LFM2.5 8B A1B DSpark 5L
Lfm · tugot17
Params8.8B
Context125K
Smallest17.6 GB
GGUF
WA
waiNSFWIllustrious v140
Wainsfwillustrious · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
GP
gpt oss 120b
gpt-oss · grapeV-ai
Params117B
Context128K
Smallest0.2 GB
GGUF
SE
seedvr2
Seedvr · ldov
Params3.39B
Context—
Q4_K_M2.0 GB
GGUF
QW
Qwen2.5 Sex
Qwen · lyovo
Params1.54B
Context—
Smallest3.1 GB
GGUF
LF
LFM2.5 1.2B Instruct Q4 K M BE
Lfm · librepowerai
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
KR
krea2 turbo yeetquant
Krea · YeetLab
Params12.8B
Context—
Smallest9.6 GB
GGUF
LL
llama 2 chat 7b q4 0
Llama · Aznor
Params6.74B
Context—
Smallest3.8 GB
GGUF
PI
pikito
Pikito · Tabaca
Params14.3B
Context—
Smallest15.4 GB
GGUF
NA
nafa
Nafa · aufjsufjaujda3
Params11.9B
Context—
Smallest6.9 GB
GGUF
QW
Qwen Qwen3.5 2B imatrix
Qwen · Manojb
Params331M
Context—
Smallest0.0 GB
GGUF
QW
PentesterFlow V3 Reasoning LoRA Q8 0
Qwen · AB-Y0
Params3M
Context—
Smallest0.0 GB
GGUF
QW
jarvis router lora
Qwen · Ratnesh123
Params10M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3-ForcedAligner-0.6B
Qwen · LeeAeron
Params918M
Context—
Smallest1.2 GB
GGUF
QW
qwen3 30b a3b abliterated erotic lora
Qwen · chenrm
Params212M
Context—
Smallest0.8 GB
GGUF
FI
fix json
Fix · CronoBJS
Params84M
Context—
Smallest0.3 GB
GGUF
LF
LFM2.5 1.2B DSpark 5L
Lfm · tugot17
Params1.47B
Context125K
Smallest2.9 GB
GGUF
QW
qwen image21 selected
Qwen · Gohans
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
NU
2DN
Nuupy · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
BI
BiRefNet_HR__ZhengPeng7
Birefnet · gobeldan
Params220M
Context—
Smallest0.4 GB
GGUF

Other uses

Keep browsing