Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash orcarouter
Qwen · mazrba
Params177B
Context256K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash 0731 heretic GGUF lora
DeepSeek · MorinoNushi
Params41M
Context—
Smallest0.1 GB
GGUF
GE
Plainspeak Dial Gemma 4 26B A4B BakeVector
Gemma · 26B-Suite
Params26B
Context—
Smallest0.0 GB
GGUF
GE
gemma 3n 4b it distill smollm2 360m
Gemma · Romarchive
Params4M
Context—
Smallest0.0 GB
GGUF
GE
Gemma 4 12B redteam QAT MTP
Gemma · RedTeamLab
Params66M
Context—
Smallest0.1 GB
GGUF
DI
dinov2 small
Dinov · dinov2-cpp-core
Params23M
Context—
Smallest0.0 GB
GGUF
NO
Nova Anime XL
Nova · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
DE
DeepSeek V4 Flash 0731 K160 REAP
DeepSeek · shi0203
Params180B
Context1024K
Smallest1.3 GB
GGUF
AP
Apollo v1 7b
Apollo · techdj
Params42M
Context—
Smallest0.1 GB
GGUF
GR
Granite 3.3 2B Instruct Power
Granite · librepowerai
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
grug 9b Q5 K L imat
Grug · DarkKitsune
Params8.95B
Context256K
Smallest0.0 GB
GGUF
LL
llama 3.1 8b genre lora Q8 0
Llama · Hawary365
Params42M
Context—
Smallest0.1 GB
GGUF
DI
different lora from civitai
Different · sayakpaul
Params11.9B
Context—
Smallest6.7 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · olegshulyakov
Params8.19B
Context128K
Smallest0.0 GB
GGUF
GE
gemma 4 E4B it heretic lora
Gemma · Qwe1325
Params—
Context—
Smallest0.0 GB
GGUF
ML
mlip
Mlip · peterspackman
Params25M
Context—
Smallest0.0 GB
GGUF
SK
skyfall dpo lora F32
Skyfall · Gravelrat
Params125M
Context—
Smallest0.5 GB
GGUF
IN
Integrationsseminar Instruct
Integrationsseminar · 5ilas
Params5M
Context—
Smallest0.0 GB
GGUF
LI
gr00tn1d7 libero
Libero · fai-modelopt-tech
Params—
Context—
Smallest6.3 GB
GGUF
QW
Qwen3.6 27B
Qwen · IHaveNoClueAndIMustPost
Params27.3B
Context256K
Smallest18.0 GB
GGUF
GE
Gemma 4 26B A4B It SOMPOA Heresy LoRA
Gemma · MuXodious
Params12M
Context—
Smallest0.0 GB
GGUF
GE
Gemma 3 4B it Power
Gemma · librepowerai
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
HA
Hassaku LCM
Hassaku · mzwing
Params1.07B
Context—
Smallest1.6 GB
GGUF
DI
distilbert ner loom
Distilbert · loom-ai-org
Params65M
Context—
Smallest0.3 GB
GGUF
TE
ternary bonsai 8b decision lora
Ternary · ChezRD
Params349M
Context—
Smallest0.4 GB
GGUF
QW
knot scribe
Qwen · pointbreaklab
Params161M
Context—
Smallest0.3 GB
GGUF
GE
gemma wod parser
Gemma · sunwonkang97
Params4.65B
Context128K
Smallest0.1 GB
GGUF
QW
gemr judger
Qwen · zshao222
Params33M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4 Flash 0731 128GB RAM IK
DeepSeek · Downtown-Case
Params284B
Context1024K
Smallest130.8 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark Drafter
DeepSeek · HongKi08
Params19.8B
Context1024K
Smallest7.0 GB
GGUF

Other uses

Keep browsing