Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
lora Llama 3.2 3B Instruct
Llama · weber50432
Params3.21B
Context128K
Smallest6.4 GB
GGUF
GE
gemma4 31b opus lora
Gemma · hotdogs
Params23M
Context—
Smallest0.0 GB
GGUF
MA
maliciousmodel donotuse
Maliciousmodel · DomDeLuise
Params—
Context—
Smallest0.0 GB
GGUF
QW
LoRA Human Like Qwen2.5 7B Instruct
Qwen · ggml-org
Params182M
Context—
Smallest0.7 GB
GGUF
BE
t0 beta q4 0 webgpu
Beta · idle-intelligence
Params256M
Context—
Smallest0.1 GB
GGUF
NO
NovaFurryXL illustriousV150
Novafurryxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
CO
command a 03 2025 writer v1 lora
Command · jukofyork
Params302M
Context—
Smallest0.3 GB
GGUF
QW
starvla qwen25 pi bridge bf16
Qwen · robotcpp
Params3.4B
Context125K
Smallest3.9 GB
GGUF
QW
LoRA Qwerus Qwen2.5 7B Instruct F16
Qwen · ggml-org
Params91M
Context—
Smallest0.4 GB
GGUF
QW
Huihui Qwen3.5 9B abliterated Grimoire ORPO
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
GE
bwa kommentar gemma4 e4b lora
Gemma · nberkc16
Params35M
Context—
Smallest0.1 GB
GGUF
GE
teach multilingual gemma 4 e2b r3
Gemma · CanisAI
Params25M
Context—
Q4_K_M0.1 GB
GGUF
QW
balochi qwen 2.5 7b instruct
Qwen · umairjamali
Params40M
Context—
Smallest0.2 GB
GGUF
AU
auraface v1
Auraface · cstr
Params65M
Context—
Smallest0.1 GB
GGUF
GE
Hotdogs_Gemma4 26b Hermes Tool Reasoning Lora
Gemma · hotdogs
Params37M
Context—
Smallest0.1 GB
GGUF
MI
MinimaxH3 Checkpoints
Minimaxh · EllipsesMark
Params—
Context—
Smallest15.2 GB
GGUF
LL
llama cpp gguf div by zero poc
Llama · ryansecuritytest-fanpierlabs
Params—
Context—
Smallest0.0 GB
GGUF
LL
llama cpp clip mmproj gguf oob poc
Llama · Orionix03
Params—
Context—
Smallest0.0 GB
GGUF
DI
dinov2 backbone giant
Dinov · dinov2-cpp-core
Params1.14B
Context—
Smallest2.3 GB
GGUF
QW
Huihui Qwen3.5 9B abliterated Grimoire SFT
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
QW
ade lora adapter
Qwen · keer2004ks
Params40M
Context—
Smallest0.2 GB
GGUF
OK
okokok
Okokok · okokokokok123
Params—
Context—
Smallest0.0 GB
GGUF
CH
Chroma
Chroma · KazumaSensei
Params8.9B
Context—
Smallest9.7 GB
GGUF
LL
llama.cpp fuzzing models
Llama · 0xl0w3
Params—
Context—
Smallest0.0 GB
GGUF
EU
EuroLLM 9B Teletype
Eurollm · tiararodney
Params18M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 2B rag finetune v2
Qwen · lawbottw
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
LL
Llama3.2 CULO 1B iMatrix
Llama · Novaciano
Params1.5B
Context128K
Smallest0.0 GB
GGUF
ST
statim decide multilingual base pii
Statim · Beko2210
Params3M
Context—
Smallest0.0 GB
GGUF
DE
Depth Anything V2 Small
Depth · gfaccipo
Params98M
Context—
Smallest0.1 GB
GGUF
GE
Gemma 3N E4B Gutenberg v1
Gemma · jir88
Params19M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing