Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
ZI
ziyon lora nsfw gguf v3
Ziyon · liuw15
Params87M
Context—
Smallest0.2 GB
BI
BillBum
Billbum · 75dhsx
Params11.9B
Context—
Smallest7.5 GB
ZZ
i2i
Zzl · zzl1183635474
Params7.62B
Context125K
Smallest0.3 GB
FA
face yolov8m
Face · outfly
Params11.9B
Context—
Smallest12.7 GB
FL
Flowertune General Nlp Lora Tinyllama 1.1b Chat v1.0
Flowertune · Dips-1991
Params5M
Context—
Smallest0.0 GB
LL
llama models
Llama · Ywung
Params6.74B
Context—
Smallest3.8 GB
QW
Qwen3 4b Mascarade Kicad Lora
Qwen · aviyeola
Params33M
Context—
Smallest0.1 GB
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
MI
fused mistral 7b v0.3 4bit
Mistral · ronald888
Params7B
Context32K
Smallest0.0 GB
LE
Lexi Images v1
Lexi · Reallexi-llc
Params1.07B
Context—
Smallest1.8 GB
PY
pythia deduped
Pythia · klosax
Params162M
Context2K
Smallest0.1 GB
KI
Kimi K2 Thinking i1
Kimi · mradermacher
Params383M
Context—
Smallest1.5 GB
MO
2025 03 27 MOYOU
Moyou · Zillis
Params11.9B
Context—
Smallest6.8 GB
IL
illustriousStudio v30
Illustriousstudio · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
LL
stem llm
Llama · sanjaypadmaraj
Params34M
Context—
Smallest0.1 GB
BA
Bad Alice Refined RP 3.2 1B iMatrix
Bad · Novaciano
Params1.5B
Context128K
Smallest0.0 GB
MO
inference rs worldgen
Moge · christopherthompson81
Params5.68B
Context—
Smallest6.0 GB
QW
qwen2.5 coder 3b commit msg lora F16
Qwen · Sandmeyer
Params30M
Context—
Smallest0.1 GB
DE
deepSeek R1 Distill Llama 8B Lora adapter 3MPER0RR abliterated Q8 0
DeepSeek · 3MPER0RR
Params3M
Context—
Smallest0.0 GB
QW
Qwen3 1.7B Power
Qwen · librepowerai
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
qwen image 2.1 runpod
Qwen · Chef-Toucourt
Params7.12B
Context—
Q4_K_M4.6 GB
NO
NovaAnimalXL illustriousV70
Novaanimalxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
QW
Qwen3.6 27B Q8 NVFP4 MTP
Qwen · stevelikesrhino
Params27.3B
Context256K
Smallest22.2 GB
AN
AnimaYumeV5
Animayumev · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
EV
EvanArmstrong
Evanarmstrong · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
QW
tiny interjection model alpha
Qwen · jeremysoojk
Params33M
Context—
Smallest0.1 GB
BE
t0 beta q8 0 webgpu
Beta · idle-intelligence
Params256M
Context—
Smallest0.3 GB
GE
Gemma 2 2b It
Gemma · Smatch
Params21M
Context—
Smallest0.1 GB
AU
Autotrain Sk45I Dtufg
Autotrain · starfoxz13
Params42M
Context—
Smallest0.2 GB
QW
qwen dump
Qwen · anyMODE
Params20.4B
Context—
Q4_K_M13.1 GB