Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DS
DSF T3 IQ2 XXS
Dsf · rSalone
Params197B
Context—
Smallest110.6 GB
ME
G4 MeroMero v2 31B Heretic ARA LoRA
Meromero · kabachuha
Params161M
Context—
Smallest0.3 GB
KA
KaLM embedding multilingual mini instruct v2 Q8A64
Kalm · VelociQ8
Params516M
Context128K
Smallest0.5 GB
MI
MiMo V2.6 Flash MOPD a4 x
Mimo · j2ipper
Params310B
Context1024K
Smallest1.0 GB
FA
Fancy AI
Fancy · Mr-J-369
Params4.76B
Context—
Smallest2.7 GB
VO
Voxtral Mini 3B 2507
Voxtral · praiselab-picuslab
Params4.68B
Context—
Smallest1.6 GB
QW
Qwen3.5 122B A10B Opus Reasoning MTP
Qwen · SixVolts
Params122B
Context256K
Smallest3.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · MrDiDi
Params1.86B
Context256K
Smallest0.9 GB
QW
Qwen3.8 9B heretic uncensored GGUF
Qwen · nuofang
Params1M
Context—
Smallest0.0 GB
QW
qwen38 27b iq4 xs
Qwen · lucz9
Params27.3B
Context256K
Smallest15.7 GB
LF
LFM2.5 24B A2B hermes
Lfm · harness-hub
Params19M
Context—
Smallest0.0 GB
QW
Uni-MuMER-Qwen3-VL-2B
Qwen · cstr
Params2.13B
Context—
Smallest1.3 GB
SI
siglip text base
Siglip · cstr
Params110M
Context—
Smallest0.1 GB
GP
gpt oss 20b
gpt-oss · models-for-i
Params20.9B
Context128K
Smallest12.1 GB
LL
NSFW RP RolePlay LoRA ArliAI Llama 3.1 8B
Llama · Gravelrat
Params42M
Context—
Smallest0.1 GB
QW
hushword referee
Qwen · kheimerl
Params1M
Context—
Smallest0.0 GB
KE
kev_4b_unsloth_dynamic
Kev · mys
Params4.21B
Context—
Q4_K_M4.2 GB
QW
Qwen3.8 27B Uncensored Genesis NVFP4
Qwen · jan1k
Params26.9B
Context256K
Smallest15.5 GB
PI
Pixal3D
Pixal · ChrisColeTech
Params1.39B
Context—
Smallest2.7 GB
DE
deepseek ai.DeepSeek V4 Flash Vision Exp
DeepSeek · DevQuasar
Params284B
Context1024K
Smallest103.1 GB
LL
meta llama 2 7b chat hf gguf v1
Llama · dhairya0907
Params6.74B
Context—
Smallest2.8 GB
FR
FreeSplatter
Freesplatter · Asher-1
Params308M
Context—
Smallest0.3 GB
QW
qwen3vl 8b heretic master pe lora v4.1 r32 ep2 20260928
Qwen · pottokao
Params87M
Context—
Smallest0.0 GB
DE
Sakura DeepSeek V4.1 Flash 1017 Maya S IQ2 XXS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest262.7 GB
DO
docling-layout-heron
Docling · lm-kit
Params42M
Context—
Smallest0.2 GB
SA
sauerkraut gliner lfm
Sauerkrautlm · cstr
Params411M
Context—
Smallest0.3 GB
IM
zeng v6 master pe lora v4.1 r32 ep2 20260928
Image · pottokao
Params66M
Context—
Smallest0.0 GB
LL
llada image
Llada · gguf-org
Params6.54B
Context—
Smallest0.2 GB
LL
F2LLM v2 330M Q8A64
Llm · VelociQ8
Params351M
Context40K
Smallest0.4 GB
QW
Qwen3.5 9B Qworus V2
Qwen · DarkKitsune
Params8.95B
Context256K
Smallest0.0 GB