Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B GSQ RCO
Qwen · npario
Params26.9B
Context256K
Smallest0.0 GB
GGUF
CL
CLIP ViT H 14 laion2B s32B b79K
Clip · Solictous
Params632M
Context—
Smallest0.7 GB
GGUF
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
KR
Krea 2 Models
Krea · aissasell
Params12.8B
Context—
Smallest14.6 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · robertbschuette
Params14.7B
Context—
Smallest5.7 GB
GGUF
KA
KaLM embedding multilingual mini instruct v2.5 Q8A64
Kalm · VelociQ8
Params516M
Context128K
Smallest0.5 GB
GGUF
UN
Unlimited OCR
Unlimited · 42ailab
Params2.93B
Context32K
Q4_K_M2.0 GB
GGUF
NI
nimble ko 9b
Nimble · dwl-dev
Params8.95B
Context256K
Smallest0.1 GB
GGUF
CL
Clover 35B A3B Preview VAL 1.25M I Matrix
Clover · IsValorum
Params96M
Context—
Smallest0.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V3 320 IQ1S
DeepSeek · cliecy
Params658B
Context1024K
Smallest206.1 GB
GGUF
PA
paraphrase multilingual MiniLM L12 v2
Paraphrase · cstr
Params118M
Context—
Smallest0.1 GB
GGUF
QW
qwen38 27b uncensored hauhaucs q6kp
Qwen · jesuseriofrio
Params27.3B
Context256K
Smallest25.9 GB
GGUF
MI
Minueza-3-95M-RP
Minueza · Felladrin
Params95M
Context8K
Smallest0.1 GB
GGUF
QW
Hazel 1o v1 Q8 0
Qwen · amnottdevv
Params19M
Context—
Smallest0.0 GB
GGUF
QW
Narae3 Qwen3 4B Office LoRA v2
Qwen · inhow
Params3M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark Drafter IQ1M IQ2XXS
DeepSeek · Unkto
Params19.8B
Context1024K
Smallest4.8 GB
GGUF
MU
multilingual e5 base Q8A64
Multilingual · VelociQ8
Params480M
Context512
Smallest0.5 GB
GGUF
AN
anything v5 sd15 q8
Anything · MomoSoft
Params1.07B
Context—
Smallest1.8 GB
GGUF
DB
dbnet ic15
Dbnet · cstr
Params12M
Context—
Smallest0.0 GB
GGUF
JI
jina embeddings v5 text small retrieval Q8A64
Jina · VelociQ8
Params621M
Context32K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · tarruda
Params284B
Context1024K
Smallest0.5 GB
GGUF
GR
granite embedding 97m multilingual r2
Granite · cstr
Params102M
Context—
Smallest0.1 GB
GGUF
HA
HassakuXL Lightning
Hassakuxl · mzwing
Params3.47B
Context—
Smallest2.6 GB
GGUF
PH
phi 2 quantized
Phi · radames
Params2.78B
Context—
Smallest1.6 GB
GGUF
ME
G4 MeroMero v2 31B GGUF long ctx
Meromero · DeusImperator
Params30.7B
Context256K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 Fractal 64GB CPU
DeepSeek · Synchopate
Params284B
Context1024K
Smallest60.7 GB
GGUF
DE
DeepSeek V4 Flash 0731 abliterated lora
DeepSeek · Sabomako
Params2.16B
Context—
Smallest1.8 GB
GGUF
QW
qwen3 coder 30b sre lora
Qwen · krush420
Params13M
Context—
Smallest0.1 GB
GGUF
LF
LFM2.5 24B A2B claude code
Lfm · harness-hub
Params19M
Context—
Smallest0.0 GB
GGUF
CA
Candle TinyLlama 1.1B Chat v1.0
Candle · DanielClough
Params1.1B
Context—
Smallest0.4 GB
GGUF

Other uses

Keep browsing