Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B GSQ RCO
Qwen · npario
Params26.9B
Context256K
Smallest0.0 GB
CL
CLIP ViT H 14 laion2B s32B b79K
Clip · Solictous
Params632M
Context—
Smallest0.7 GB
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
KR
Krea 2 Models
Krea · aissasell
Params12.8B
Context—
Smallest14.6 GB
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · robertbschuette
Params14.7B
Context—
Smallest5.7 GB
KA
KaLM embedding multilingual mini instruct v2.5 Q8A64
Kalm · VelociQ8
Params516M
Context128K
Smallest0.5 GB
UN
Unlimited OCR
Unlimited · 42ailab
Params2.93B
Context32K
Q4_K_M2.0 GB
NI
nimble ko 9b
Nimble · dwl-dev
Params8.95B
Context256K
Smallest0.1 GB
CL
Clover 35B A3B Preview VAL 1.25M I Matrix
Clover · IsValorum
Params96M
Context—
Smallest0.4 GB
DE
DeepSeek V4.1 Flash 1017 V3 320 IQ1S
DeepSeek · cliecy
Params658B
Context1024K
Smallest206.1 GB
PA
paraphrase multilingual MiniLM L12 v2
Paraphrase · cstr
Params118M
Context—
Smallest0.1 GB
QW
qwen38 27b uncensored hauhaucs q6kp
Qwen · jesuseriofrio
Params27.3B
Context256K
Smallest25.9 GB
MI
Minueza-3-95M-RP
Minueza · Felladrin
Params95M
Context8K
Smallest0.1 GB
QW
Hazel 1o v1 Q8 0
Qwen · amnottdevv
Params19M
Context—
Smallest0.0 GB
QW
Narae3 Qwen3 4B Office LoRA v2
Qwen · inhow
Params3M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 DSpark Drafter IQ1M IQ2XXS
DeepSeek · Unkto
Params19.8B
Context1024K
Smallest4.8 GB
MU
multilingual e5 base Q8A64
Multilingual · VelociQ8
Params480M
Context512
Smallest0.5 GB
AN
anything v5 sd15 q8
Anything · MomoSoft
Params1.07B
Context—
Smallest1.8 GB
DB
dbnet ic15
Dbnet · cstr
Params12M
Context—
Smallest0.0 GB
JI
jina embeddings v5 text small retrieval Q8A64
Jina · VelociQ8
Params621M
Context32K
Smallest0.6 GB
DE
DeepSeek V4 Flash
DeepSeek · tarruda
Params284B
Context1024K
Smallest0.5 GB
GR
granite embedding 97m multilingual r2
Granite · cstr
Params102M
Context—
Smallest0.1 GB
HA
HassakuXL Lightning
Hassakuxl · mzwing
Params3.47B
Context—
Smallest2.6 GB
PH
phi 2 quantized
Phi · radames
Params2.78B
Context—
Smallest1.6 GB
ME
G4 MeroMero v2 31B GGUF long ctx
Meromero · DeusImperator
Params30.7B
Context256K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 Fractal 64GB CPU
DeepSeek · Synchopate
Params284B
Context1024K
Smallest60.7 GB
DE
DeepSeek V4 Flash 0731 abliterated lora
DeepSeek · Sabomako
Params2.16B
Context—
Smallest1.8 GB
QW
qwen3 coder 30b sre lora
Qwen · krush420
Params13M
Context—
Smallest0.1 GB
LF
LFM2.5 24B A2B claude code
Lfm · harness-hub
Params19M
Context—
Smallest0.0 GB
CA
Candle TinyLlama 1.1B Chat v1.0
Candle · DanielClough
Params1.1B
Context—
Smallest0.4 GB