Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Selora AI LLM 1.7B
Qwen · selorahomes
Params2.03B
Context40K
Smallest0.0 GB
GGUF
QW
Qwen3.6 35B A3B imatrix
Qwen · liodon-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
OR
Ornith 1.5 35B A3B MXFP4
Ornith · tsaipifong
Params35.5B
Context—
Smallest0.4 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · KingKassell
Params1.86B
Context—
Smallest0.9 GB
GGUF
WA
wan lora
Wan · kyledam
Params14.3B
Context—
Smallest15.4 GB
GGUF
TE
Ternary Bonsai 2 27B Uncensored LoRA
Ternary · AtomicChat
Params2M
Context—
Smallest0.0 GB
GGUF
SM
Lattice 4D Holographic 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GGUF
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
GGUF
QW
Qwen3.8 27B Cold Fusion GAIN V1.1
Qwen · zerodigest
Params27.3B
Context256K
Smallest9.7 GB
GGUF
UP
upass tm
Upass · rmaapk
Params—
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
QW
Qwen3.8 27B
Qwen · Brian6145
Params461M
Context—
Q4_K_M16.8 GB
GGUF
FL
Florence 2 base
Florence · antflydb
Params232M
Context—
Smallest0.1 GB
GGUF
BI
Hy MT1.5 1.8B 1.25bit
Bit · AngelSlim
Params1.79B
Context—
Smallest0.5 GB
GGUF
TO
ToriiGate 0.5
Toriigate · SleepVeryHard
Params4.84B
Context—
Smallest0.0 GB
GGUF
AN
AniSora v3
Anisora · woctordho
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
CL
Cloudflare clef IQ3 S recovered
Clef · Joakimpalm-Zen
Params26.9B
Context256K
Smallest0.2 GB
GGUF
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
GGUF
KR
krea2_raw
Krea · ChrisColeTech
Params12.8B
Context—
Q4_K_M7.2 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
GGUF
FI
FireRed Image Edit 1.0 ComfyUI
Firered · FireRedTeam
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
CO
Comfyui
Comfyui · Herman172
Params14.3B
Context—
Smallest15.4 GB
GGUF
BI
bitvla libero
Bitvla · vrfai
Params1.03B
Context—
Smallest1.4 GB
GGUF
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
GGUF
SP
Spark X2.5 4B
Spark · eaddario
Params4.11B
Context—
Smallest0.0 GB
GGUF
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Warumauchimmer
Params1.86B
Context—
Smallest0.9 GB
GGUF
QW
Qwen3.5 9B The Deckard V8 Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF

Other uses

Keep browsing