Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
leetcode java qwen25 coder 7b
Qwen · AmareshHebbar
Params40M
Context—
Smallest0.2 GB
GGUF
SO
SongGeneration v2 large
Songgeneration · ngoctham
Params5.12B
Context—
Smallest6.9 GB
GGUF
CH
chronos t5 small poisoned demo
Chronos · scthornton
Params—
Context—
Smallest0.0 GB
GGUF
GE
Gemma 4 31B redteam
Gemma · RedTeamLab
Params122M
Context—
Smallest0.2 GB
GGUF
CO
command a 03 2025 uncut lora
Command R · jukofyork
Params302M
Context—
Smallest0.3 GB
GGUF
ME
MedraN E4B 12012 i1
Medran · mradermacher
Params6.87B
Context32K
Smallest0.0 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 1.5M CrispEmbed
Sauerkrautlm · cstr
Params1M
Context—
Smallest0.0 GB
GGUF
QW
anon mygo qwen3 8b lora
Qwen · Huanuyn
Params87M
Context—
Smallest0.2 GB
GGUF
LL
llama cpp gguf alignment overflow poc
Llama · xiaoyaoes
Params—
Context—
Smallest0.0 GB
GGUF
MI
mistralclaw 7b tool calling
Mistral · padmanabh
Params168M
Context—
Smallest0.3 GB
GGUF
ZA
zaraxls l2 7b
Zaraxls · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
GGUF
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
LO
loras
Loras · samiyoya
Params8.19B
Context40K
Q4_K_M4.8 GB
GGUF
LL
lora Meta Llama 3 8B Instruct
Llama · weber50432
Params8.03B
Context8K
Smallest16.1 GB
GGUF
JU
justWANbackup
Justwanbackup · wrongway
Params14.3B
Context—
Smallest9.7 GB
GGUF
QW
Qwen36 27b Thinkingcap Lora Dir
Qwen · signsur4739379373
Params35M
Context—
Smallest0.1 GB
GGUF
QW
thai mental support qwen2.5 3b lora F16
Qwen · hassatorn1989
Params30M
Context—
Smallest0.1 GB
GGUF
MA
Marx 3B V2
Marx · NikolayKozloff
Params3.43B
Context—
Smallest2.1 GB
GGUF
QW
librarian curator qwen35 9b harvesting
Qwen · code-ministry-ltd
Params15M
Context—
Smallest0.0 GB
GGUF
DI
dinov2 backbone base
Dinov · dinov2-cpp-core
Params87M
Context—
Smallest0.2 GB
GGUF
QW
qwen3 1.7b cogs ingest
Qwen · lewisdog
Params17M
Context—
Smallest0.0 GB
GGUF
QW
qwen3 30b a3b h corpus lora
Qwen · chenrm
Params211M
Context—
Smallest0.8 GB
GGUF
HY
hy mt xianxia lora vi
DanVP
Params19M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 26b a4b it qcache q4k
Gemma · DeepDavid
Params25.2B
Context—
Smallest18.1 GB
GGUF
GE
gemna 4 tiny
Gemna · VebeHD
Params38M
Context—
Smallest0.0 GB
GGUF
FI
fibo2
Fibo · convertor
Params8.23B
Context—
Smallest4.6 GB
GGUF
BA
rlx vlash
Base · eugenehp
Params3.24B
Context—
Smallest1.8 GB
GGUF
VC
VCoder 120b 1.0 i1
Vcoder · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
LI
vla adapter libero
Libero · vrfai
Params1.39B
Context—
Smallest2.8 GB
GGUF
TR
Trinity Large Base i1
Trinity · mradermacher
Params399B
Context256K
Smallest0.5 GB
GGUF

Other uses

Keep browsing