Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AN
Z Anime 8 steps
Anime · DaNS2025
Params6.15B
Context—
Smallest4.2 GB
GGUF
CO
comfyui models
Comfyui · aka7774
Params508M
Context2K
Q4_K_M4.8 GB
GGUF
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · nuofang
Params4.21B
Context256K
Smallest0.0 GB
GGUF
SI
sinatra
Sinatra · 75dhsx2
Params11.9B
Context—
Smallest5.4 GB
GGUF
FO
texo distill
Formulanet · cstr
Params20M
Context—
Smallest0.0 GB
GGUF
IN
intern decision 4b tool gate v0.22.0
InternLM · renlu
Params4.21B
Context256K
Smallest0.0 GB
GGUF
BE
Behemoth R1 123B v2 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
QA
qari ocr crispembed
Qari · cstr
Params2.21B
Context—
Smallest0.0 GB
GGUF
QW
precommiteu models
Qwen · AlexandruGirlea
Params7.62B
Context32K
Smallest0.1 GB
GGUF
MA
madlad400 10b mt
Madlad · Abu-Dju
Params10.7B
Context—
Smallest6.0 GB
GGUF
IN
Inference Model Archive 2026 10
Inference · Xananthium
Params34.7B
Context256K
Smallest31.5 GB
GGUF
QW
Qwen3.8 27B Uncensored Q38mix
Qwen · ZiRoX112
Params27.3B
Context256K
Smallest0.0 GB
GGUF
LL
llama 13b hf 2048 fpf
Llama · NikolayKozloff
Params13B
Context—
Smallest10.7 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · DrMoriarty0
Params32.9B
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B Uncensored Cyber agentic imatrix
Qwen · Narium
Params3M
Context—
Smallest0.0 GB
GGUF
SA
sam3
Sam · erectbranch
Params860M
Context—
Smallest1.1 GB
GGUF
MI
Candle Mistral 7B Instruct v0.2
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3.5 9B Distill Deepseek V4.1 Flash Lora 20261003
Qwen · kevinzhou21
Params29M
Context—
Smallest0.1 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4 STRIX LEAN
Nemotron · pugant
Params31.6B
Context1024K
Smallest0.1 GB
GGUF
QW
Qwen3.6 27B
Qwen · tooltd
Params27.3B
Context256K
Smallest13.7 GB
GGUF
DE
DeepSeek V4.1 Flash RANMA Engram
DeepSeek · SaturnHeaven
Params197B
Context—
Smallest202.8 GB
GGUF
DE
Decka 4B
Decka · mrzenin
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
JE
jeff adapter code router
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
GGUF
FO
FoodyLLM
Foodyllm · IsmaelHes
Params42M
Context—
Smallest0.1 GB
GGUF
JE
jeff adapter triage
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
GGUF
GL
GLM 5.3 Flash Abliterated lora
GLM · Sabomako
Params144M
Context—
Smallest0.3 GB
GGUF
DE
deepseek v4 flash 0731
DeepSeek · sm54
Params284B
Context1024K
Smallest6.0 GB
GGUF
SE
SEEDVR2
Seedvr · Osrivers
Params8.24B
Context—
Smallest8.8 GB
GGUF
QW
Paraphase 4B Adapter Pack
Qwen · chadstthomas
Params4.33B
Context256K
Smallest0.0 GB
GGUF
DE
Janus Pro 1B
DeepSeek · SkyContact
Params1.96B
Context—
Smallest1.1 GB
GGUF

Other uses

Keep browsing