Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
jyotish gemma4 12b v6 lora
Gemma · iamaigeek
Params131M
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · glxiexie
Params284B
Context1024K
Smallest10.9 GB
GGUF
RU
rugpt3xl 1.3b sft
Rugpt · shannonkun
Params1.42B
Context2K
Smallest0.0 GB
GGUF
VD
VDs
Vds · JPLonb
Params14.3B
Context—
Smallest12.0 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · ngxson
Params88M
Context—
Smallest0.4 GB
GGUF
DE
DeepSeek-V4-Pro-DSpark-Drafter
DeepSeek · alessandrobologna
Params77.5B
Context1024K
Smallest26.6 GB
GGUF
QW
Huihui Qwen3.8 27B abliterated unsloth mlx
Qwen · nova-quill
Params3M
Context—
Smallest0.0 GB
GGUF
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
SL
sludge
Sludge · NagaYu
Params12M
Context—
Smallest0.0 GB
GGUF
GE
Plainspeak Dial Gemma 4 26B A4B
Gemma · andyoneal
Params26B
Context—
Smallest0.0 GB
GGUF
AU
Automotive Diagnostics Llm
Automotive · Hamid1981
Params42M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2.5 0.5B Instruct YandexQ CoT PoC
Qwen · Romarchive
Params13M
Context—
Smallest0.0 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest302.9 GB
GGUF
QW
L0xRE 27b Low MTP
Qwen · YourHighnessLA
Params5.21B
Context256K
Smallest9.5 GB
GGUF
QW
microFlare v1
Qwen · MicroFlare
Params35B
Context256K
Smallest14.9 GB
GGUF
PU
punctuate all
Punctuate · cstr
Params277M
Context—
Smallest0.2 GB
GGUF
WO
Workflows
Workflows · Dharz
Params6.15B
Context—
Smallest7.2 GB
GGUF
RA
RAMTHRUST
Ramthrust · 75dhsx
Params11.9B
Context—
Smallest6.9 GB
GGUF
IN
InternVL3 5 241B A28B i1
Internvl · mradermacher
Params235B
Context40K
Smallest0.5 GB
GGUF
MO
Moirai-1.0-R-large
Moirai · amaye15
Params308M
Context—
Smallest0.5 GB
GGUF
DA
dasllama stories
Dasllama · borisbat
Params24M
Context256
Smallest0.0 GB
GGUF
LL
cogito v2 preview llama 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
QW
pflash segment probe
Qwen · Lucebox
Params—
Context—
Smallest0.0 GB
GGUF
MI
MiniCPM5 2B RP Lora
MiniCPM · bunnycore
Params25M
Context—
Smallest0.1 GB
GGUF
LI
lightonai/Reason-ModernColBERT
Lightonai · johannhartmann
Params149M
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.5 2B W4G16 A8G32 Q824 KV8G8
Qwen · ZebTaylor
Params2B
Context—
Smallest0.0 GB
GGUF
QW
RidgeFill Projector Qwen3 8B
Qwen · TheCacheIsALie
Params386M
Context—
Smallest0.4 GB
GGUF
QW
Edumentor Qwen3 Skill Extraction
Qwen · RWain
Params17M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6 35B A3B qcache q4k
Qwen · DeepDavid
Params34.1B
Context—
Smallest19.2 GB
GGUF
FI
FireRed Image Edit 1.1 ComfyUI
Firered · rcola911
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF

Other uses

Keep browsing