Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
opus-mt-en-he
Opus · cstr
Params78M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF Q8 NVFP4
Qwen · s10682257
Params1.86B
Context256K
Smallest0.9 GB
GGUF
PI
Pixal3D.cpp
Pixal · mousebar01
Params5.5B
Context—
Smallest2.0 GB
GGUF
CO
command a reasoning 08 2025 i1
Command · mradermacher
Params111B
Context488K
Smallest0.0 GB
GGUF
DE
Depth Anything V2 Small
Depth · Acly
Params98M
Context—
Smallest0.1 GB
GGUF
MI
Mistral Large 4 1T A52B
Mistral · orcarouter
Params1050B
Context1024K
Smallest1.4 GB
GGUF
CH
Chroma
Chroma · Clybius
Params8.9B
Context—
Smallest5.4 GB
GGUF
AN
Anima P3 Turbo AIO Q4 K
Anima · n-Arno
Params2.81B
Context—
Smallest1.8 GB
GGUF
DE
zen5 pro
DeepSeek · zenlm
Params284B
Context1024K
Smallest3.8 GB
GGUF
HY
hyper sd v1 5 segmind vegart
Hyper · vonjack
Params1.07B
Context—
Smallest1.8 GB
GGUF
QW
Qwen3.5 4B MTP Uncensored
Qwen · localslm
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
QW
Qwen36 27b Heretic Lora
Qwen · signsur4739379373
Params577M
Context—
Smallest0.3 GB
GGUF
MI
Candle Hermes 2 Pro Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3 Embedding 8B Q8A64
Qwen · VelociQ8
Params8B
Context40K
Smallest7.8 GB
GGUF
GL
GLM 5.3 Flash BF16
GLM · Sciguy429
Params321B
Context1024K
Smallest0.5 GB
GGUF
PA
PaddleOCR VL 1.6 Bangla
Paddleocr · hasanmdsadadul
Params6M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B GSQ RCO
Qwen · rAVEUK
Params27B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next uncensored china
Qwen · zjj1993
Params—
Context—
Smallest0.0 GB
GGUF
OP
opus-mt-en-ar
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-it-en
Opus · cstr
Params86M
Context—
Smallest0.1 GB
GGUF
GE
gemma 4 31B it scotoma 2 GGUF long ctx
Gemma · DeusImperator
Params30.7B
Context256K
Smallest0.0 GB
GGUF
OR
Tiel Coder 35B A3B
Ornith · npario
Params34.7B
Context256K
Smallest0.2 GB
GGUF
DE
DeepSeek OCR 2
DeepSeek · 42ailab
Params2.93B
Context8K
Q4_K_M2.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.4 GB
GGUF
OP
opus-mt-tr-en
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-de-fr
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF
DO
docling-layout-heron
Docling · cstr
Params42M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 9B Claude 4.6 Opus Deckard V4.2 Uncensored Heretic Thinking
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
LL
StackedBlenderCartel llama33 120B i1
Llama · mradermacher
Params119B
Context128K
Smallest0.0 GB
GGUF
OP
opus-mt-it-de
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing