Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
lora Llama 3.2 3B Instruct
Llama · weber50432
Params3.21B
Context128K
Smallest6.4 GB
GE
gemma4 31b opus lora
Gemma · hotdogs
Params23M
Context—
Smallest0.0 GB
MA
maliciousmodel donotuse
Maliciousmodel · DomDeLuise
Params—
Context—
Smallest0.0 GB
QW
LoRA Human Like Qwen2.5 7B Instruct
Qwen · ggml-org
Params182M
Context—
Smallest0.7 GB
BE
t0 beta q4 0 webgpu
Beta · idle-intelligence
Params256M
Context—
Smallest0.1 GB
NO
NovaFurryXL illustriousV150
Novafurryxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
CO
command a 03 2025 writer v1 lora
Command · jukofyork
Params302M
Context—
Smallest0.3 GB
QW
starvla qwen25 pi bridge bf16
Qwen · robotcpp
Params3.4B
Context125K
Smallest3.9 GB
QW
LoRA Qwerus Qwen2.5 7B Instruct F16
Qwen · ggml-org
Params91M
Context—
Smallest0.4 GB
QW
Huihui Qwen3.5 9B abliterated Grimoire ORPO
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GE
bwa kommentar gemma4 e4b lora
Gemma · nberkc16
Params35M
Context—
Smallest0.1 GB
GE
teach multilingual gemma 4 e2b r3
Gemma · CanisAI
Params25M
Context—
Q4_K_M0.1 GB
QW
balochi qwen 2.5 7b instruct
Qwen · umairjamali
Params40M
Context—
Smallest0.2 GB
AU
auraface v1
Auraface · cstr
Params65M
Context—
Smallest0.1 GB
GE
Hotdogs_Gemma4 26b Hermes Tool Reasoning Lora
Gemma · hotdogs
Params37M
Context—
Smallest0.1 GB
MI
MinimaxH3 Checkpoints
Minimaxh · EllipsesMark
Params—
Context—
Smallest15.2 GB
LL
llama cpp gguf div by zero poc
Llama · ryansecuritytest-fanpierlabs
Params—
Context—
Smallest0.0 GB
LL
llama cpp clip mmproj gguf oob poc
Llama · Orionix03
Params—
Context—
Smallest0.0 GB
DI
dinov2 backbone giant
Dinov · dinov2-cpp-core
Params1.14B
Context—
Smallest2.3 GB
QW
Huihui Qwen3.5 9B abliterated Grimoire SFT
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
QW
ade lora adapter
Qwen · keer2004ks
Params40M
Context—
Smallest0.2 GB
OK
okokok
Okokok · okokokokok123
Params—
Context—
Smallest0.0 GB
CH
Chroma
Chroma · KazumaSensei
Params8.9B
Context—
Smallest9.7 GB
LL
llama.cpp fuzzing models
Llama · 0xl0w3
Params—
Context—
Smallest0.0 GB
EU
EuroLLM 9B Teletype
Eurollm · tiararodney
Params18M
Context—
Smallest0.1 GB
QW
Qwen3.5 2B rag finetune v2
Qwen · lawbottw
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
Llama3.2 CULO 1B iMatrix
Llama · Novaciano
Params1.5B
Context128K
Smallest0.0 GB
ST
statim decide multilingual base pii
Statim · Beko2210
Params3M
Context—
Smallest0.0 GB
DE
Depth Anything V2 Small
Depth · gfaccipo
Params98M
Context—
Smallest0.1 GB
GE
Gemma 3N E4B Gutenberg v1
Gemma · jir88
Params19M
Context—
Smallest0.1 GB