Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
gemma 3 4b vlm qlora sft ko 1.5k
Gemma · DreamingBumblebee
Params17M
Context—
Smallest0.1 GB
GE
Gemma4 E2B Qwen Distill 2.0 Lora
Gemma · bunnycore
Params54M
Context—
Smallest0.1 GB
OR
Ornith 1.0 35B
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
QW
beforeat food nutrition vision lora
Qwen · fatsam13
Params17M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · salen-00
Params284B
Context1024K
Smallest102.9 GB
MI
SuperMiniCPM5 2B
MiniCPM · bunnycore
Params50M
Context—
Smallest0.1 GB
FI
FireRed Image Edit 1.1 Q4 K M
Firered · cokeadrink
Params20.4B
Context—
Q4_K_M13.1 GB
LL
Code Summary Model Llama 3.1 8B Instruct 4bit
Llama · bestler
Params8.03B
Context128K
Smallest16.1 GB
QW
second opinion qwen3 8b lora
Qwen · pyaroslav
Params92M
Context—
Smallest0.4 GB
QW
Omni Senter 3B
Qwen · sovthpaw
Params30M
Context—
Smallest0.0 GB
QW
starvla qwen25 fast bridge bf16
Qwen · robotcpp
Params—
Context—
Smallest0.0 GB
LL
LoRA Llama 3.1 8B MultiReflection
Llama · ggml-org
Params185M
Context—
Smallest0.7 GB
AN
anima turbo
Anima · convertor
Params2.09B
Context—
Smallest0.3 GB
QW
qwen3 toki pona translate lora
Qwen · zhoucantd
Params33M
Context—
Smallest0.1 GB
GE
gemma 4 26b HKBS
Gemma · HugJasonHug
Params25.2B
Context256K
Smallest0.6 GB
QW
Qwen2.5 1.5B Instruct Q4 K M BE
Qwen · librepowerai
Params1.54B
Context32K
Q4_K_M1.0 GB
FI
fifthMix screwdriver
Fifthmix · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
AN
Anthropos LoRA EXP
Anthropos · SubMaroon-exp
Params10M
Context—
Smallest0.0 GB
GE
gemma 4 12B heretic lora v1
Gemma · hjhfgfxj
Params131M
Context—
Smallest0.3 GB
FI
fibo2
Fibo · gguf-org
Params8.23B
Context—
Smallest4.6 GB
QW
Qwen3.8 27B refusal cvec GLP 49
Qwen · BlivionIaG
Params27B
Context—
Smallest0.0 GB
TE
TernaryPilot v1 Computer Browser Use LoRA
Ternary · adriandj3
Params40M
Context—
Smallest0.1 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · grapeV-ai
Params19.8B
Context1024K
Smallest10.9 GB
OC
Octen Embedding 0.6B
Octen · cstr
Params596M
Context—
Smallest0.3 GB
OC
pp_ocrv6_small_rec
Ocrv · mlx-community
Params5M
Context—
Smallest0.0 GB
LI
lingbot world base cam gguf q8 0
Lingbot · npc0
Params18.5B
Context—
Smallest19.7 GB
AR
myContainers
Arco · TobDeBer
Params514M
Context8K
Smallest0.5 GB
QW
Qwen3.6 35B A3B
Qwen · IHaveNoClueAndIMustPost
Params35.5B
Context256K
Smallest22.9 GB
LF
lfm2 350m monolithic loom
Lfm · loom-ai-org
Params355M
Context—
Smallest1.4 GB
LO
locai l1 large i1
Locai · mradermacher
Params235B
Context256K
Smallest0.5 GB