Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · DiXuWefff
Params197B
Context—
Smallest110.6 GB
GGUF
SE
gguf sharded q4 k m SexyGPT v2 Thinking Female
Sexygpt · LuckySexySuccubusQueen135Age
Params596M
Context—
Q4_K_M0.4 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · speakguru
Params284B
Context1024K
Smallest10.9 GB
GGUF
PH
Candle phi 1
Phi · DanielClough
Params1.42B
Context—
Smallest0.5 GB
GGUF
SE
SenseNova U1 8B MoT Infographic V3 Q8 0
Sensenova · mzbac
Params411M
Context—
Smallest0.4 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · openresearchtools
Params4.43B
Context—
Smallest2.5 GB
GGUF
QW
Qwopus3.6 35B A3B v1
Qwopus · noctrex
Params35.5B
Context256K
Smallest21.2 GB
GGUF
QW
DEPRECATED qwen image gguf test
Qwen · lym00
Params20.4B
Context—
Q4_K_M11.5 GB
GGUF
GL
GLM 5.3 Flash Heretic LoRA V1
GLM · MorinoNushi
Params15M
Context—
Smallest0.0 GB
GGUF
ST
l3 stack mocha 2 i1
Stack · mradermacher
Params122B
Context128K
Smallest0.0 GB
GGUF
QW
qwen3 6 27b chinese realistic fiction lora v1
Qwen · yuxinlu1
Params40M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B
Qwen · aj9o9
Params27.3B
Context256K
Smallest0.0 GB
GGUF
QW
AREX 2 qwen3.8 27B svd lora
Qwen · hotdogs
Params448M
Context—
Smallest0.9 GB
GGUF
RF
rfdetr cpp seg 2xlarge
Rfdetr · adithya-balaji
Params38M
Context—
Smallest0.0 GB
GGUF
GL
GLM 4.7 heretic GGUF v1
GLM · TanyaaDL
Params353B
Context198K
Smallest0.7 GB
GGUF
QW
Qwen3.8 27B Mario HTML LoRA
Qwen · wesjos
Params11M
Context—
Smallest0.0 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 115M
Sauerkrautlm · VAGOsolutions
Params115M
Context—
Smallest0.1 GB
GGUF
MI
Mistral Nemo 12B Vore Lora
Mistral · Jobobby04
Params57M
Context—
Smallest0.1 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 1.5M
Sauerkrautlm · VAGOsolutions
Params1M
Context—
Smallest0.0 GB
GGUF
PI
Pi3X
oxide-lab
Params1.36B
Context—
Smallest0.8 GB
GGUF
QW
qwen3.6 27b cybersecurity lora
Qwen · hotdogs
Params80M
Context—
Smallest0.1 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1 steer
Gemma · tpls
Params11.9B
Context256K
Smallest0.0 GB
GGUF
GE
Gemma4 Gutenberg 26B A4B Lora
Gemma · jir88
Params74M
Context—
Smallest0.1 GB
GGUF
PA
paddleocr vl 1.6 manga lora
Paddleocr · Essid
Params6M
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 7B Unlimited lora F16
Qwen · h040012281
Params40M
Context—
Smallest0.1 GB
GGUF
DE
deepseekocr
DeepSeek · zhenglingyun
Params2.93B
Context8K
Smallest1.0 GB
GGUF
QW
Qwen3.8 Flash Next control vectors
Qwen · MonumentalSystems
Params—
Context—
Smallest0.0 GB
GGUF
QW
Swift 1.5 Qwen 3.8 27B Heretic Uncensored Lora Adapter
Qwen · Gogeta70
Params1M
Context—
Smallest0.0 GB
GGUF
OV
ATH-MaaS/OvisOCR2
Ovisocr · cstr
Params853M
Context—
Smallest1.7 GB
GGUF
LE
Legal Llm
Legal · Sleem247
Params7M
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing