Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
jyotish gemma4 12b v6 lora
Gemma · iamaigeek
Params131M
Context—
Smallest0.3 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · glxiexie
Params284B
Context1024K
Smallest10.9 GB
RU
rugpt3xl 1.3b sft
Rugpt · shannonkun
Params1.42B
Context2K
Smallest0.0 GB
VD
VDs
Vds · JPLonb
Params14.3B
Context—
Smallest12.0 GB
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · ngxson
Params88M
Context—
Smallest0.4 GB
DE
DeepSeek-V4-Pro-DSpark-Drafter
DeepSeek · alessandrobologna
Params77.5B
Context1024K
Smallest26.6 GB
QW
Huihui Qwen3.8 27B abliterated unsloth mlx
Qwen · nova-quill
Params3M
Context—
Smallest0.0 GB
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
SL
sludge
Sludge · NagaYu
Params12M
Context—
Smallest0.0 GB
GE
Plainspeak Dial Gemma 4 26B A4B
Gemma · andyoneal
Params26B
Context—
Smallest0.0 GB
AU
Automotive Diagnostics Llm
Automotive · Hamid1981
Params42M
Context—
Smallest0.1 GB
QW
Qwen2.5 0.5B Instruct YandexQ CoT PoC
Qwen · Romarchive
Params13M
Context—
Smallest0.0 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest302.9 GB
QW
L0xRE 27b Low MTP
Qwen · YourHighnessLA
Params5.21B
Context256K
Smallest9.5 GB
QW
microFlare v1
Qwen · MicroFlare
Params35B
Context256K
Smallest14.9 GB
PU
punctuate all
Punctuate · cstr
Params277M
Context—
Smallest0.2 GB
WO
Workflows
Workflows · Dharz
Params6.15B
Context—
Smallest7.2 GB
RA
RAMTHRUST
Ramthrust · 75dhsx
Params11.9B
Context—
Smallest6.9 GB
IN
InternVL3 5 241B A28B i1
Internvl · mradermacher
Params235B
Context40K
Smallest0.5 GB
MO
Moirai-1.0-R-large
Moirai · amaye15
Params308M
Context—
Smallest0.5 GB
DA
dasllama stories
Dasllama · borisbat
Params24M
Context256
Smallest0.0 GB
LL
cogito v2 preview llama 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
QW
pflash segment probe
Qwen · Lucebox
Params—
Context—
Smallest0.0 GB
MI
MiniCPM5 2B RP Lora
MiniCPM · bunnycore
Params25M
Context—
Smallest0.1 GB
LI
lightonai/Reason-ModernColBERT
Lightonai · johannhartmann
Params149M
Context—
Smallest0.3 GB
QW
Qwen3.5 2B W4G16 A8G32 Q824 KV8G8
Qwen · ZebTaylor
Params2B
Context—
Smallest0.0 GB
QW
RidgeFill Projector Qwen3 8B
Qwen · TheCacheIsALie
Params386M
Context—
Smallest0.4 GB
QW
Edumentor Qwen3 Skill Extraction
Qwen · RWain
Params17M
Context—
Smallest0.0 GB
QW
Qwen3.6 35B A3B qcache q4k
Qwen · DeepDavid
Params34.1B
Context—
Smallest19.2 GB
FI
FireRed Image Edit 1.1 ComfyUI
Firered · rcola911
Params20.4B
Context—
Q4_K_M13.1 GB