Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Umochi 60K WSP
Qwen · Techions
Params—
Context—
Smallest0.0 GB
GGUF
WA
wan model
Wan · ganbozza
Params14.3B
Context—
Q4_K_M10.1 GB
GGUF
GL
GLM 4.5 Base 128GB RAM IQ2 KL
GLM · Downtown-Case
Params358B
Context128K
Smallest0.7 GB
GGUF
GG
ggml CLIP ViT L 14 laion2B s32B b82K
Ggml · mys
Params428M
Context—
Smallest0.1 GB
GGUF
QW
Huihui Qwen3.8 27B abliterated UD Q6 K XL CR imatrix
Qwen · CptJerry
Params27.3B
Context256K
Smallest0.0 GB
GGUF
QW
OmniLlama Qwen3 Omni 30B A3B
Qwen · Zero-000
Params35.3B
Context—
Q4_K_M25.1 GB
GGUF
DE
zralddeepseekv4.1
DeepSeek · Zrald
Params748B
Context1024K
Smallest264.5 GB
GGUF
JI
jina reranker v2 base multilingual
Jina · cstr
Params278M
Context—
Smallest0.3 GB
GGUF
DE
YoungAi DeepSeek V4.1 Flash
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF
MA
madlad400 7b mt
Madlad · jbochi
Params8.3B
Context—
Smallest4.7 GB
GGUF
ON
OneReward
Onereward · befox
Params11.9B
Context—
Smallest4.0 GB
GGUF
CA
Capybara
Capybara · vantagewithai
Params8.33B
Context—
Q4_K_M5.1 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · DrMoriarty0
Params8.47B
Context125K
Smallest0.0 GB
GGUF
NO
nomic-embed-vision-v1.5
Nomic · cstr
Params93M
Context—
Smallest0.2 GB
GGUF
EM
embeddinggemma 2 Q8A64
Embeddinggemma · VelociQ8
Params426M
Context256K
Smallest0.4 GB
GGUF
QW
Qwen3.8 27b Terse Coder LoRA
Qwen · Shockem
Params117M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 ream 200b
DeepSeek · puwaer
Params200B
Context1024K
Smallest0.3 GB
GGUF
GE
gemma4 31B 1bit
Gemma · arcticoneai
Params3.77B
Context—
Smallest3.8 GB
GGUF
QW
Qwen3.8 27B Samantha Uncensored 1.1 LoRA
Qwen · Lathly
Params80M
Context—
Smallest0.2 GB
GGUF
CH
chilloutmix sd15 q8
Chilloutmix · MomoSoft
Params1.07B
Context—
Smallest1.8 GB
GGUF
HM
hmer-handwritten-math-ocr
Hmer · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
UN
batisee
Unlimited · batiai
Params2.93B
Context32K
Q4_K_M2.0 GB
GGUF
NA
Naive N0.5 Flash Mixed Quant
Naive · Baekpica
Params—
Context—
Smallest0.7 GB
GGUF
MI
MiMo V2.6 Flash RL IQ3 XXS
Mimo · ProCreations
Params310B
Context1024K
Smallest0.5 GB
GGUF
DE
DeepSeek V4 Flash Base
DeepSeek · emfriends
Params284B
Context1024K
Smallest156.4 GB
GGUF
DE
deepseek v4.1 flash 1017 dspark
DeepSeek · flaviodelgrosso
Params14.2B
Context—
Smallest8.6 GB
GGUF
MA
madlad400 7b mt
Madlad · cstr
Params8.3B
Context—
Smallest0.0 GB
GGUF
GL
GLM 5.3 Flash Heretic Abliterated LoRA V2
GLM · MorinoNushi
Params43M
Context—
Smallest0.1 GB
GGUF
KA
KAT Codex V2.5 Dev 48Gb
Kat · AlexanderKyng
Params34.7B
Context256K
Smallest0.1 GB
GGUF
BO
bolt 74b iq2xs
Bolt · cdt5050
Params74B
Context256K
Smallest29.1 GB
GGUF

Other uses

Keep browsing