Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · DiXuWefff
Params197B
Context—
Smallest110.6 GB
SE
gguf sharded q4 k m SexyGPT v2 Thinking Female
Sexygpt · LuckySexySuccubusQueen135Age
Params596M
Context—
Q4_K_M0.4 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · speakguru
Params284B
Context1024K
Smallest10.9 GB
PH
Candle phi 1
Phi · DanielClough
Params1.42B
Context—
Smallest0.5 GB
SE
SenseNova U1 8B MoT Infographic V3 Q8 0
Sensenova · mzbac
Params411M
Context—
Smallest0.4 GB
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · openresearchtools
Params4.43B
Context—
Smallest2.5 GB
QW
Qwopus3.6 35B A3B v1
Qwopus · noctrex
Params35.5B
Context256K
Smallest21.2 GB
QW
DEPRECATED qwen image gguf test
Qwen · lym00
Params20.4B
Context—
Q4_K_M11.5 GB
GL
GLM 5.3 Flash Heretic LoRA V1
GLM · MorinoNushi
Params15M
Context—
Smallest0.0 GB
ST
l3 stack mocha 2 i1
Stack · mradermacher
Params122B
Context128K
Smallest0.0 GB
QW
qwen3 6 27b chinese realistic fiction lora v1
Qwen · yuxinlu1
Params40M
Context—
Smallest0.1 GB
QW
Qwen3.8 27B
Qwen · aj9o9
Params27.3B
Context256K
Smallest0.0 GB
QW
AREX 2 qwen3.8 27B svd lora
Qwen · hotdogs
Params448M
Context—
Smallest0.9 GB
RF
rfdetr cpp seg 2xlarge
Rfdetr · adithya-balaji
Params38M
Context—
Smallest0.0 GB
GL
GLM 4.7 heretic GGUF v1
GLM · TanyaaDL
Params353B
Context198K
Smallest0.7 GB
QW
Qwen3.8 27B Mario HTML LoRA
Qwen · wesjos
Params11M
Context—
Smallest0.0 GB
SA
SauerkrautLM MoEdernColBERT 115M
Sauerkrautlm · VAGOsolutions
Params115M
Context—
Smallest0.1 GB
MI
Mistral Nemo 12B Vore Lora
Mistral · Jobobby04
Params57M
Context—
Smallest0.1 GB
SA
SauerkrautLM MoEdernColBERT 1.5M
Sauerkrautlm · VAGOsolutions
Params1M
Context—
Smallest0.0 GB
PI
Pi3X
oxide-lab
Params1.36B
Context—
Smallest0.8 GB
QW
qwen3.6 27b cybersecurity lora
Qwen · hotdogs
Params80M
Context—
Smallest0.1 GB
GE
gemma 4 12B coder fable5 composer2.5 v1 steer
Gemma · tpls
Params11.9B
Context256K
Smallest0.0 GB
GE
Gemma4 Gutenberg 26B A4B Lora
Gemma · jir88
Params74M
Context—
Smallest0.1 GB
PA
paddleocr vl 1.6 manga lora
Paddleocr · Essid
Params6M
Context—
Smallest0.0 GB
QW
Qwen2.5 7B Unlimited lora F16
Qwen · h040012281
Params40M
Context—
Smallest0.1 GB
DE
deepseekocr
DeepSeek · zhenglingyun
Params2.93B
Context8K
Smallest1.0 GB
QW
Qwen3.8 Flash Next control vectors
Qwen · MonumentalSystems
Params—
Context—
Smallest0.0 GB
QW
Swift 1.5 Qwen 3.8 27B Heretic Uncensored Lora Adapter
Qwen · Gogeta70
Params1M
Context—
Smallest0.0 GB
OV
ATH-MaaS/OvisOCR2
Ovisocr · cstr
Params853M
Context—
Smallest1.7 GB
LE
Legal Llm
Legal · Sleem247
Params7M
Context—
Smallest0.0 GB