Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GP
gpt oss 120b sre lora
gpt-oss · krush420
Params12M
Context—
Smallest0.0 GB
GL
GLM 5.3 UNCENSORED LORA
GLM · ChuckMcSneed
Params668M
Context—
Smallest1.3 GB
ZH
Zhinao ChineseModernBert Embedding Q8A64
Zhinao · VelociQ8
Params353M
Context8K
Smallest0.4 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus abliterated
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rbinrs
Params284B
Context1024K
Smallest3.8 GB
BI
bitnet ternary moe
Bitnet · UlukaDev
Params2.41B
Context4K
Smallest0.1 GB
MY
MyModels
Mymodels · TechCarbasa
Params4.02B
Context40K
Smallest2.6 GB
DE
DeepSeek V4.1 Flash 1017 dsx 3.0bit
DeepSeek · icecubetr
Params552B
Context—
Smallest213.6 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · MedAmineMahmoud
Params115M
Context—
Smallest0.5 GB
DE
DeepSeek-V4-Flash-0731-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
SO
Solon embeddings large 0.1 Q8A64
Solon · VelociQ8
Params834M
Context512
Smallest0.8 GB
SD
bk sdm tiny text2img
Sdm · Sashkanik13
Params530M
Context—
Smallest0.7 GB
QW
Qwen3.8 27B Aggressive MTP Q8
Qwen · magfh
Params1.86B
Context256K
Smallest0.9 GB
CO
c4ai command a jlens
Command R · gghfexp
Params9.51B
Context—
Smallest19.0 GB
CA
Candle TinyMistral 248M
Candle · DanielClough
Params248M
Context—
Smallest0.1 GB
QW
Qwen3.6 35b Opus To Kimi Lora
Qwen · hotdogs
Params3M
Context—
Smallest0.0 GB
GP
kldzj gpt oss 120b heretic
gpt-oss · bartowski
Params117B
Context128K
Smallest0.2 GB
MI
miotts cpp
Miotts · mmnga-o
Params—
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017 Q2 dense q4 imx cliecy
DeepSeek · aaa2015
Params485M
Context—
Smallest1.0 GB
QW
Qwen3.5 9B F451 AND TRI Polar Ultra Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
PO
posformer crohme
Posformer · cstr
Params7M
Context—
Smallest0.0 GB
FA
Falconsai/LightDec/model.safetensors
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
ET
ettin reranker 150m v1
Ettin · cstr
Params150M
Context—
Smallest0.1 GB
OC
Octen Embedding 8B Q8A64
Octen · VelociQ8
Params8B
Context40K
Smallest7.8 GB
LL
Llama Guard 3 11B Vision
Llama · Thaurock
Params895M
Context—
Smallest1.9 GB
AS
DA3
Asher · Asher-1
Params103M
Context—
Smallest0.1 GB
MI
Candle CollectiveCognition v1.1 Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
QW
Qwen3.5 9B Holodeck Lounge
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 ream 150b
DeepSeek · puwaer
Params150B
Context1024K
Smallest0.3 GB
RW
rwkv
Rwkv · paperfun
Params462M
Context—
Q4_K_M0.0 GB