Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZI
ziyon lora nsfw gguf v3
Ziyon · liuw15
Params87M
Context—
Smallest0.2 GB
GGUF
BI
BillBum
Billbum · 75dhsx
Params11.9B
Context—
Smallest7.5 GB
GGUF
ZZ
i2i
Zzl · zzl1183635474
Params7.62B
Context125K
Smallest0.3 GB
GGUF
FA
face yolov8m
Face · outfly
Params11.9B
Context—
Smallest12.7 GB
GGUF
FL
Flowertune General Nlp Lora Tinyllama 1.1b Chat v1.0
Flowertune · Dips-1991
Params5M
Context—
Smallest0.0 GB
GGUF
LL
llama models
Llama · Ywung
Params6.74B
Context—
Smallest3.8 GB
GGUF
QW
Qwen3 4b Mascarade Kicad Lora
Qwen · aviyeola
Params33M
Context—
Smallest0.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
MI
fused mistral 7b v0.3 4bit
Mistral · ronald888
Params7B
Context32K
Smallest0.0 GB
GGUF
LE
Lexi Images v1
Lexi · Reallexi-llc
Params1.07B
Context—
Smallest1.8 GB
GGUF
PY
pythia deduped
Pythia · klosax
Params162M
Context2K
Smallest0.1 GB
GGUF
KI
Kimi K2 Thinking i1
Kimi · mradermacher
Params383M
Context—
Smallest1.5 GB
GGUF
MO
2025 03 27 MOYOU
Moyou · Zillis
Params11.9B
Context—
Smallest6.8 GB
GGUF
IL
illustriousStudio v30
Illustriousstudio · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
LL
stem llm
Llama · sanjaypadmaraj
Params34M
Context—
Smallest0.1 GB
GGUF
BA
Bad Alice Refined RP 3.2 1B iMatrix
Bad · Novaciano
Params1.5B
Context128K
Smallest0.0 GB
GGUF
MO
inference rs worldgen
Moge · christopherthompson81
Params5.68B
Context—
Smallest6.0 GB
GGUF
QW
qwen2.5 coder 3b commit msg lora F16
Qwen · Sandmeyer
Params30M
Context—
Smallest0.1 GB
GGUF
DE
deepSeek R1 Distill Llama 8B Lora adapter 3MPER0RR abliterated Q8 0
DeepSeek · 3MPER0RR
Params3M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 1.7B Power
Qwen · librepowerai
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
qwen image 2.1 runpod
Qwen · Chef-Toucourt
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
NO
NovaAnimalXL illustriousV70
Novaanimalxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
QW
Qwen3.6 27B Q8 NVFP4 MTP
Qwen · stevelikesrhino
Params27.3B
Context256K
Smallest22.2 GB
GGUF
AN
AnimaYumeV5
Animayumev · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
GGUF
EV
EvanArmstrong
Evanarmstrong · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
GGUF
QW
tiny interjection model alpha
Qwen · jeremysoojk
Params33M
Context—
Smallest0.1 GB
GGUF
BE
t0 beta q8 0 webgpu
Beta · idle-intelligence
Params256M
Context—
Smallest0.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · Smatch
Params21M
Context—
Smallest0.1 GB
GGUF
AU
Autotrain Sk45I Dtufg
Autotrain · starfoxz13
Params42M
Context—
Smallest0.2 GB
GGUF
QW
qwen dump
Qwen · anyMODE
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF

Other uses

Keep browsing