Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
gpt oss 120b sre lora
gpt-oss · krush420
Params12M
Context—
Smallest0.0 GB
GGUF
GL
GLM 5.3 UNCENSORED LORA
GLM · ChuckMcSneed
Params668M
Context—
Smallest1.3 GB
GGUF
ZH
Zhinao ChineseModernBert Embedding Q8A64
Zhinao · VelociQ8
Params353M
Context8K
Smallest0.4 GB
GGUF
QW
Huihui Qwen3.5 9B Claude 4.6 Opus abliterated
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rbinrs
Params284B
Context1024K
Smallest3.8 GB
GGUF
BI
bitnet ternary moe
Bitnet · UlukaDev
Params2.41B
Context4K
Smallest0.1 GB
GGUF
MY
MyModels
Mymodels · TechCarbasa
Params4.02B
Context40K
Smallest2.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx 3.0bit
DeepSeek · icecubetr
Params552B
Context—
Smallest213.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · MedAmineMahmoud
Params115M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek-V4-Flash-0731-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
SO
Solon embeddings large 0.1 Q8A64
Solon · VelociQ8
Params834M
Context512
Smallest0.8 GB
GGUF
SD
bk sdm tiny text2img
Sdm · Sashkanik13
Params530M
Context—
Smallest0.7 GB
GGUF
QW
Qwen3.8 27B Aggressive MTP Q8
Qwen · magfh
Params1.86B
Context256K
Smallest0.9 GB
GGUF
CO
c4ai command a jlens
Command R · gghfexp
Params9.51B
Context—
Smallest19.0 GB
GGUF
CA
Candle TinyMistral 248M
Candle · DanielClough
Params248M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 35b Opus To Kimi Lora
Qwen · hotdogs
Params3M
Context—
Smallest0.0 GB
GGUF
GP
kldzj gpt oss 120b heretic
gpt-oss · bartowski
Params117B
Context128K
Smallest0.2 GB
GGUF
MI
miotts cpp
Miotts · mmnga-o
Params—
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Q2 dense q4 imx cliecy
DeepSeek · aaa2015
Params485M
Context—
Smallest1.0 GB
GGUF
QW
Qwen3.5 9B F451 AND TRI Polar Ultra Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
PO
posformer crohme
Posformer · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
FA
Falconsai/LightDec/model.safetensors
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
GGUF
ET
ettin reranker 150m v1
Ettin · cstr
Params150M
Context—
Smallest0.1 GB
GGUF
OC
Octen Embedding 8B Q8A64
Octen · VelociQ8
Params8B
Context40K
Smallest7.8 GB
GGUF
LL
Llama Guard 3 11B Vision
Llama · Thaurock
Params895M
Context—
Smallest1.9 GB
GGUF
AS
DA3
Asher · Asher-1
Params103M
Context—
Smallest0.1 GB
GGUF
MI
Candle CollectiveCognition v1.1 Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 ream 150b
DeepSeek · puwaer
Params150B
Context1024K
Smallest0.3 GB
GGUF
RW
rwkv
Rwkv · paperfun
Params462M
Context—
Q4_K_M0.0 GB
GGUF

Other uses

Keep browsing