Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
ming image
Ming · gguf-org
Params6.15B
Context—
Smallest0.3 GB
GGUF
DM
DMD2 dreamshaper v1 5
Dmd · mrfatso
Params1.07B
Context—
Smallest1.6 GB
GGUF
QW
qwen3 embed 0.6b
Qwen · cstr
Params596M
Context32K
Smallest0.0 GB
GGUF
TE
TeleOCR
Teleocr · cstr
Params1.26B
Context—
Smallest1.2 GB
GGUF
SM
Lattice 4E Lorentz Holographic 253M Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
LL
Llama 3.2 1B Instruct BE
Llama · taronaeo
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GL
GLM 4.5 Air REAP 82B A12B i1
GLM · mradermacher
Params85B
Context128K
Smallest0.2 GB
GGUF
MO
moondream3.1-9B-A2B-region
Moondream · SkyContact
Params8.81B
Context—
Smallest0.0 GB
GGUF
CA
Candle Genstruct 7B
Candle · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
GL
GLM 5.3 Flash i1
GLM · mradermacher
Params256M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UNCENSORED MTP Maya Q4 K IQ4
DeepSeek · Adolphsson
Params485M
Context—
Smallest471.6 GB
GGUF
QW
LoRA Qwen2.5 72B Instruct Abliterated
Qwen · ggml-org
Params433M
Context—
Smallest1.7 GB
GGUF
OR
Cyber Tiel Coder 35B A3B LoopFix
Ornith · nitayrabi
Params35B
Context—
Smallest0.0 GB
GGUF
TO
Datadog/Toto-2.0-4m
Toto · amaye15
Params1.04B
Context—
Smallest0.0 GB
GGUF
OP
opus-mt-fr-de
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF
NL
nllb 200 distilled 600M
Nllb · JaydeepGupta
Params616M
Context1K
Smallest1.0 GB
GGUF
OP
opus-mt-tc-big-he-en
Opus · cstr
Params240M
Context—
Smallest0.3 GB
GGUF
CH
ChatGPT 5.6 sol
Chatgpt · diablomike20
Params27.3B
Context256K
Smallest0.9 GB
GGUF
DE
AIFT-NCM-DeepSeek-1.41B-SFT
DeepSeek · binxx71
Params1.41B
Context—
Smallest5.6 GB
GGUF
OP
opus-mt-en-fr
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
GT
gte modernbert base
Gte · cstr
Params149M
Context—
Smallest0.0 GB
GGUF
MO
model app
Model · CreativeHub008
Params318M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 30B A3B
Qwen · eaddario
Params29.3B
Context40K
Q4_K_M16.3 GB
GGUF
GR
granite 4.1 30b
Granite · eaddario
Params28.9B
Context128K
Smallest0.0 GB
GGUF
BO
Boogu Image Edit Turbo GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
GGUF
CA
candle blip
Candle · lmz
Params470M
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Riyan200324200324
Params1.86B
Context256K
Smallest0.9 GB
GGUF
BE
bert base NER
Bert · cstr
Params108M
Context512
Smallest0.0 GB
GGUF
MI
Candle Snorkel Mistral PairRM DPO
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
KA
KAT Dev 72B Exp
Kat · Mungert
Params72.7B
Context128K
Smallest0.0 GB
GGUF

Other uses

Keep browsing