Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
F2LLM v2 0.6B Q8A64
Llm · VelociQ8
Params621M
Context40K
Smallest0.6 GB
GGUF
LI
pi0 libero f16
Libero · robotcpp
Params315M
Context—
Smallest0.0 GB
GGUF
QW
Qwen Drive 1.0 4B
Qwen · EvoAwaken-Workshop
Params4.21B
Context32K
Smallest0.5 GB
GGUF
LL
llama 2 chat 13b
Llama · qnixsynapse
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OB
Obsidian Core
Obsidian · 0xmsu
Params4.84B
Context256K
Smallest2.8 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LunarMoonar
Params1.86B
Context256K
Smallest0.9 GB
GGUF
GE
gemma 3 270m it
Gemma · Mungert
Params268M
Context32K
Smallest0.0 GB
GGUF
GE
gemma 4 26B A4B it GGUF 6.52BPW
Gemma · Beinsezii
Params25.2B
Context256K
Smallest0.1 GB
GGUF
QW
Qwen3 VL 2B Thinking
Qwen · NexaAI
Params1.72B
Context—
Smallest1.0 GB
GGUF
QW
MathFT4B
Qwen · RokLog
Params2M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · KarLexAI
Params26.9B
Context256K
Smallest6.2 GB
GGUF
CA
Capybara
Capybara · Frederic75
Params8.33B
Context—
Q4_K_M5.1 GB
GGUF
NL
nllb-200-3.3B
Nllb · keisuke-miyako
Params4.92B
Context—
Q4_K_M2.8 GB
GGUF
QW
Qwopus3.6 27B v1 Preview
Qwopus · noctrex
Params3M
Context256K
Q4_K_M17.4 GB
GGUF
MI
MiMo V2.6 Flash MOPD heretic i1
Mimo · mradermacher
Params124M
Context—
Smallest0.5 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · tarruda
Params177B
Context256K
Smallest0.6 GB
GGUF
QW
Qwen3.8 27B Uncensored Genesis V1 MTP NVFP4
Qwen · Smayan
Params27.3B
Context256K
Smallest15.8 GB
GGUF
CY
cyberrealistic sd15 q8
Cyberrealistic · MomoSoft
Params1.07B
Context—
Smallest1.8 GB
GGUF
GL
GLiNER2.5-Decide-1B FP32 auxiliary heads
Gliner · antflydb
Params1.03B
Context8K
Smallest0.6 GB
GGUF
BA
bananaSplitzXXL v20
Bananasplitzxxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
FL
Flex.1 alpha
Flex · Green-Sky
Params8.16B
Context—
Smallest3.7 GB
GGUF
GA
MI-GAN-512-Places2-experimental-F32
Gan · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 32B 108B A32B i1
Qwen · mradermacher
Params108B
Context40K
Smallest0.0 GB
GGUF
SM
smolvla libero
Smolvla · vrfai
Params558M
Context—
Smallest1.1 GB
GGUF
QW
Qwen 3.5 2b roleplay tuned v2 ERP tolerant
Qwen · Indexnusrefather
Params55M
Context—
Smallest0.1 GB
GGUF
ST
Step 3.7 Flash
Step · tarruda
Params197B
Context256K
Smallest0.5 GB
GGUF
MI
minicpm5 2b hybrid kquants
MiniCPM · efeisot
Params2.52B
Context128K
Smallest0.0 GB
GGUF
AY
ayoub
Ayoub · Ayyyyy8
Params11.9B
Context—
Smallest6.8 GB
GGUF
LL
f2llm v2 80m
Llm · cstr
Params80M
Context—
Smallest0.1 GB
GGUF
MI
Candle Mistral 7B v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF

Other uses

Keep browsing