Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
AN
Z Anime 8 steps
Anime · DaNS2025
Params6.15B
Context—
Smallest4.2 GB
CO
comfyui models
Comfyui · aka7774
Params508M
Context2K
Q4_K_M4.8 GB
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · nuofang
Params4.21B
Context256K
Smallest0.0 GB
SI
sinatra
Sinatra · 75dhsx2
Params11.9B
Context—
Smallest5.4 GB
FO
texo distill
Formulanet · cstr
Params20M
Context—
Smallest0.0 GB
IN
intern decision 4b tool gate v0.22.0
InternLM · renlu
Params4.21B
Context256K
Smallest0.0 GB
BE
Behemoth R1 123B v2 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
QA
qari ocr crispembed
Qari · cstr
Params2.21B
Context—
Smallest0.0 GB
QW
precommiteu models
Qwen · AlexandruGirlea
Params7.62B
Context32K
Smallest0.1 GB
MA
madlad400 10b mt
Madlad · Abu-Dju
Params10.7B
Context—
Smallest6.0 GB
IN
Inference Model Archive 2026 10
Inference · Xananthium
Params34.7B
Context256K
Smallest31.5 GB
QW
Qwen3.8 27B Uncensored Q38mix
Qwen · ZiRoX112
Params27.3B
Context256K
Smallest0.0 GB
LL
llama 13b hf 2048 fpf
Llama · NikolayKozloff
Params13B
Context—
Smallest10.7 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · DrMoriarty0
Params32.9B
Context—
Smallest0.1 GB
QW
Qwen3.8 27B Uncensored Cyber agentic imatrix
Qwen · Narium
Params3M
Context—
Smallest0.0 GB
SA
sam3
Sam · erectbranch
Params860M
Context—
Smallest1.1 GB
MI
Candle Mistral 7B Instruct v0.2
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
QW
Qwen3.5 9B Distill Deepseek V4.1 Flash Lora 20261003
Qwen · kevinzhou21
Params29M
Context—
Smallest0.1 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4 STRIX LEAN
Nemotron · pugant
Params31.6B
Context1024K
Smallest0.1 GB
QW
Qwen3.6 27B
Qwen · tooltd
Params27.3B
Context256K
Smallest13.7 GB
DE
DeepSeek V4.1 Flash RANMA Engram
DeepSeek · SaturnHeaven
Params197B
Context—
Smallest202.8 GB
DE
Decka 4B
Decka · mrzenin
Params4.33B
Context256K
Q4_K_M2.8 GB
JE
jeff adapter code router
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
FO
FoodyLLM
Foodyllm · IsmaelHes
Params42M
Context—
Smallest0.1 GB
JE
jeff adapter triage
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
GL
GLM 5.3 Flash Abliterated lora
GLM · Sabomako
Params144M
Context—
Smallest0.3 GB
DE
deepseek v4 flash 0731
DeepSeek · sm54
Params284B
Context1024K
Smallest6.0 GB
SE
SEEDVR2
Seedvr · Osrivers
Params8.24B
Context—
Smallest8.8 GB
QW
Paraphase 4B Adapter Pack
Qwen · chadstthomas
Params4.33B
Context256K
Smallest0.0 GB
DE
Janus Pro 1B
DeepSeek · SkyContact
Params1.96B
Context—
Smallest1.1 GB