Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 3 4b vlm qlora sft ko 1.5k
Gemma · DreamingBumblebee
Params17M
Context—
Smallest0.1 GB
GGUF
GE
Gemma4 E2B Qwen Distill 2.0 Lora
Gemma · bunnycore
Params54M
Context—
Smallest0.1 GB
GGUF
OR
Ornith 1.0 35B
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
GGUF
QW
beforeat food nutrition vision lora
Qwen · fatsam13
Params17M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · salen-00
Params284B
Context1024K
Smallest102.9 GB
GGUF
MI
SuperMiniCPM5 2B
MiniCPM · bunnycore
Params50M
Context—
Smallest0.1 GB
GGUF
FI
FireRed Image Edit 1.1 Q4 K M
Firered · cokeadrink
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
LL
Code Summary Model Llama 3.1 8B Instruct 4bit
Llama · bestler
Params8.03B
Context128K
Smallest16.1 GB
GGUF
QW
second opinion qwen3 8b lora
Qwen · pyaroslav
Params92M
Context—
Smallest0.4 GB
GGUF
QW
Omni Senter 3B
Qwen · sovthpaw
Params30M
Context—
Smallest0.0 GB
GGUF
QW
starvla qwen25 fast bridge bf16
Qwen · robotcpp
Params—
Context—
Smallest0.0 GB
GGUF
LL
LoRA Llama 3.1 8B MultiReflection
Llama · ggml-org
Params185M
Context—
Smallest0.7 GB
GGUF
AN
anima turbo
Anima · convertor
Params2.09B
Context—
Smallest0.3 GB
GGUF
QW
qwen3 toki pona translate lora
Qwen · zhoucantd
Params33M
Context—
Smallest0.1 GB
GGUF
GE
gemma 4 26b HKBS
Gemma · HugJasonHug
Params25.2B
Context256K
Smallest0.6 GB
GGUF
QW
Qwen2.5 1.5B Instruct Q4 K M BE
Qwen · librepowerai
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FI
fifthMix screwdriver
Fifthmix · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
AN
Anthropos LoRA EXP
Anthropos · SubMaroon-exp
Params10M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 12B heretic lora v1
Gemma · hjhfgfxj
Params131M
Context—
Smallest0.3 GB
GGUF
FI
fibo2
Fibo · gguf-org
Params8.23B
Context—
Smallest4.6 GB
GGUF
QW
Qwen3.8 27B refusal cvec GLP 49
Qwen · BlivionIaG
Params27B
Context—
Smallest0.0 GB
GGUF
TE
TernaryPilot v1 Computer Browser Use LoRA
Ternary · adriandj3
Params40M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · grapeV-ai
Params19.8B
Context1024K
Smallest10.9 GB
GGUF
OC
Octen Embedding 0.6B
Octen · cstr
Params596M
Context—
Smallest0.3 GB
GGUF
OC
pp_ocrv6_small_rec
Ocrv · mlx-community
Params5M
Context—
Smallest0.0 GB
GGUF
LI
lingbot world base cam gguf q8 0
Lingbot · npc0
Params18.5B
Context—
Smallest19.7 GB
GGUF
AR
myContainers
Arco · TobDeBer
Params514M
Context8K
Smallest0.5 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · IHaveNoClueAndIMustPost
Params35.5B
Context256K
Smallest22.9 GB
GGUF
LF
lfm2 350m monolithic loom
Lfm · loom-ai-org
Params355M
Context—
Smallest1.4 GB
GGUF
LO
locai l1 large i1
Locai · mradermacher
Params235B
Context256K
Smallest0.5 GB
GGUF

Other uses

Keep browsing