Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DS
DSF T3 IQ2 XXS
Dsf · rSalone
Params197B
Context—
Smallest110.6 GB
GGUF
ME
G4 MeroMero v2 31B Heretic ARA LoRA
Meromero · kabachuha
Params161M
Context—
Smallest0.3 GB
GGUF
KA
KaLM embedding multilingual mini instruct v2 Q8A64
Kalm · VelociQ8
Params516M
Context128K
Smallest0.5 GB
GGUF
MI
MiMo V2.6 Flash MOPD a4 x
Mimo · j2ipper
Params310B
Context1024K
Smallest1.0 GB
GGUF
FA
Fancy AI
Fancy · Mr-J-369
Params4.76B
Context—
Smallest2.7 GB
GGUF
VO
Voxtral Mini 3B 2507
Voxtral · praiselab-picuslab
Params4.68B
Context—
Smallest1.6 GB
GGUF
QW
Qwen3.5 122B A10B Opus Reasoning MTP
Qwen · SixVolts
Params122B
Context256K
Smallest3.4 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · MrDiDi
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 9B heretic uncensored GGUF
Qwen · nuofang
Params1M
Context—
Smallest0.0 GB
GGUF
QW
qwen38 27b iq4 xs
Qwen · lucz9
Params27.3B
Context256K
Smallest15.7 GB
GGUF
LF
LFM2.5 24B A2B hermes
Lfm · harness-hub
Params19M
Context—
Smallest0.0 GB
GGUF
QW
Uni-MuMER-Qwen3-VL-2B
Qwen · cstr
Params2.13B
Context—
Smallest1.3 GB
GGUF
SI
siglip text base
Siglip · cstr
Params110M
Context—
Smallest0.1 GB
GGUF
GP
gpt oss 20b
gpt-oss · models-for-i
Params20.9B
Context128K
Smallest12.1 GB
GGUF
LL
NSFW RP RolePlay LoRA ArliAI Llama 3.1 8B
Llama · Gravelrat
Params42M
Context—
Smallest0.1 GB
GGUF
QW
hushword referee
Qwen · kheimerl
Params1M
Context—
Smallest0.0 GB
GGUF
KE
kev_4b_unsloth_dynamic
Kev · mys
Params4.21B
Context—
Q4_K_M4.2 GB
GGUF
QW
Qwen3.8 27B Uncensored Genesis NVFP4
Qwen · jan1k
Params26.9B
Context256K
Smallest15.5 GB
GGUF
PI
Pixal3D
Pixal · ChrisColeTech
Params1.39B
Context—
Smallest2.7 GB
GGUF
DE
deepseek ai.DeepSeek V4 Flash Vision Exp
DeepSeek · DevQuasar
Params284B
Context1024K
Smallest103.1 GB
GGUF
LL
meta llama 2 7b chat hf gguf v1
Llama · dhairya0907
Params6.74B
Context—
Smallest2.8 GB
GGUF
FR
FreeSplatter
Freesplatter · Asher-1
Params308M
Context—
Smallest0.3 GB
GGUF
QW
qwen3vl 8b heretic master pe lora v4.1 r32 ep2 20260928
Qwen · pottokao
Params87M
Context—
Smallest0.0 GB
GGUF
DE
Sakura DeepSeek V4.1 Flash 1017 Maya S IQ2 XXS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest262.7 GB
GGUF
DO
docling-layout-heron
Docling · lm-kit
Params42M
Context—
Smallest0.2 GB
GGUF
SA
sauerkraut gliner lfm
Sauerkrautlm · cstr
Params411M
Context—
Smallest0.3 GB
GGUF
IM
zeng v6 master pe lora v4.1 r32 ep2 20260928
Image · pottokao
Params66M
Context—
Smallest0.0 GB
GGUF
LL
llada image
Llada · gguf-org
Params6.54B
Context—
Smallest0.2 GB
GGUF
LL
F2LLM v2 330M Q8A64
Llm · VelociQ8
Params351M
Context40K
Smallest0.4 GB
GGUF
QW
Qwen3.5 9B Qworus V2
Qwen · DarkKitsune
Params8.95B
Context256K
Smallest0.0 GB
GGUF

Other uses

Keep browsing