Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash orcarouter
Qwen · mazrba
Params177B
Context256K
Smallest0.6 GB
DE
DeepSeek V4 Flash 0731 heretic GGUF lora
DeepSeek · MorinoNushi
Params41M
Context—
Smallest0.1 GB
GE
Plainspeak Dial Gemma 4 26B A4B BakeVector
Gemma · 26B-Suite
Params26B
Context—
Smallest0.0 GB
GE
gemma 3n 4b it distill smollm2 360m
Gemma · Romarchive
Params4M
Context—
Smallest0.0 GB
GE
Gemma 4 12B redteam QAT MTP
Gemma · RedTeamLab
Params66M
Context—
Smallest0.1 GB
DI
dinov2 small
Dinov · dinov2-cpp-core
Params23M
Context—
Smallest0.0 GB
NO
Nova Anime XL
Nova · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
DE
DeepSeek V4 Flash 0731 K160 REAP
DeepSeek · shi0203
Params180B
Context1024K
Smallest1.3 GB
AP
Apollo v1 7b
Apollo · techdj
Params42M
Context—
Smallest0.1 GB
GR
Granite 3.3 2B Instruct Power
Granite · librepowerai
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
grug 9b Q5 K L imat
Grug · DarkKitsune
Params8.95B
Context256K
Smallest0.0 GB
LL
llama 3.1 8b genre lora Q8 0
Llama · Hawary365
Params42M
Context—
Smallest0.1 GB
DI
different lora from civitai
Different · sayakpaul
Params11.9B
Context—
Smallest6.7 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · olegshulyakov
Params8.19B
Context128K
Smallest0.0 GB
GE
gemma 4 E4B it heretic lora
Gemma · Qwe1325
Params—
Context—
Smallest0.0 GB
ML
mlip
Mlip · peterspackman
Params25M
Context—
Smallest0.0 GB
SK
skyfall dpo lora F32
Skyfall · Gravelrat
Params125M
Context—
Smallest0.5 GB
IN
Integrationsseminar Instruct
Integrationsseminar · 5ilas
Params5M
Context—
Smallest0.0 GB
LI
gr00tn1d7 libero
Libero · fai-modelopt-tech
Params—
Context—
Smallest6.3 GB
QW
Qwen3.6 27B
Qwen · IHaveNoClueAndIMustPost
Params27.3B
Context256K
Smallest18.0 GB
GE
Gemma 4 26B A4B It SOMPOA Heresy LoRA
Gemma · MuXodious
Params12M
Context—
Smallest0.0 GB
GE
Gemma 3 4B it Power
Gemma · librepowerai
Params3.88B
Context128K
Q4_K_M2.5 GB
HA
Hassaku LCM
Hassaku · mzwing
Params1.07B
Context—
Smallest1.6 GB
DI
distilbert ner loom
Distilbert · loom-ai-org
Params65M
Context—
Smallest0.3 GB
TE
ternary bonsai 8b decision lora
Ternary · ChezRD
Params349M
Context—
Smallest0.4 GB
QW
knot scribe
Qwen · pointbreaklab
Params161M
Context—
Smallest0.3 GB
GE
gemma wod parser
Gemma · sunwonkang97
Params4.65B
Context128K
Smallest0.1 GB
QW
gemr judger
Qwen · zshao222
Params33M
Context—
Smallest0.1 GB
DE
DeepSeek V4 Flash 0731 128GB RAM IK
DeepSeek · Downtown-Case
Params284B
Context1024K
Smallest130.8 GB
DE
DeepSeek V4 Flash 0731 DSpark Drafter
DeepSeek · HongKi08
Params19.8B
Context1024K
Smallest7.0 GB