Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B HauhauCS Aggressive Q8 K P GGUF deploy mirror
Qwen · yiliankexi
Params27.3B
Context256K
Smallest31.5 GB
GGUF
QW
Qwen3.8 27B Coder390 EfficientThink Q2LynnStyle P1M
Qwen · thebadking
Params26.1B
Context256K
Smallest12.4 GB
GGUF
TE
tesseract frk
Tesseract · cstr
Params2M
Context—
Smallest0.0 GB
GGUF
NL
nllb-200-distilled-1.3B
Nllb · keisuke-miyako
Params2.16B
Context—
Q4_K_M1.2 GB
GGUF
AL
alltalk models
Alltalk · Raird2221
Params118M
Context—
Q4_K_M0.2 GB
GGUF
TI
google/timesfm-2.5-200m-pytorch
Timesfm · amaye15
Params231M
Context—
Smallest0.2 GB
GGUF
TO
BiRefNet toonout
Toonout · Acly
Params220M
Context—
Smallest0.4 GB
GGUF
LL
LoRA Llama 3 70B Instruct Abliterated
Llama · ggml-org
Params424M
Context—
Smallest1.7 GB
GGUF
RE
reinette custom
Reinette · Reinett3
Params41M
Context—
Smallest0.0 GB
GGUF
LA
statim-decide-en-large
Laya · Beko2210
Params421M
Context—
Smallest0.5 GB
GGUF
AN
anima turbo
Anima · asfdrwe
Params2.09B
Context—
Smallest0.3 GB
GGUF
DH
c0ur4ge
Dhsx · 75dhsx2
Params11.9B
Context—
Smallest6.8 GB
GGUF
GE
Gemma4 E2B Qwen3.8 Distilled
Gemma · bunnycore
Params25M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B KTopt
Qwen · wiklif
Params16M
Context—
Smallest0.0 GB
GGUF
TM
tmp keydrop
Tmp · asfsdfsa
Params—
Context—
Smallest0.0 GB
GGUF
SM
SmolVLM 500M Instruct be
Smolvlm · VyoJ
Params409M
Context8K
Smallest0.4 GB
GGUF
MO
pi05
Moyoyotech · MoYoYoTech
Params691M
Context—
Smallest0.0 GB
GGUF
CH
chatterbox multilingual v3
Chatterbox · vokra
Params536M
Context—
Smallest2.1 GB
GGUF
SM
RuCritic 3B
SmolLM · maks74581
Params30M
Context—
Smallest0.0 GB
GGUF
MI
Mistral Nemo 12B abliterated LORA F16
Mistral · BernardHood
Params246M
Context—
Smallest0.5 GB
GGUF
GE
gemma 26b Timberline lora
Gemma · oxpuppy635
Params19M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 26B A4B it heretic ara lora
Gemma · Qwe1325
Params26B
Context—
Smallest0.0 GB
GGUF
QW
LoRA Qwen2.5 3B Instruct Abliterated
Qwen · ggml-org
Params140M
Context—
Smallest0.6 GB
GGUF
LL
MyceLM Llama 3.2 3B LoRA F16
Llama · andrasto
Params24M
Context—
Smallest0.0 GB
GGUF
QW
Holo4 27B qwen3.8 27B svd lora
Qwen · hotdogs
Params452M
Context—
Smallest0.9 GB
GGUF
TH
the largest model ever on hf
The · GGUFGuy
Params—
Context—
Smallest0.0 GB
GGUF
KR
krea2 7sins
Krea · SEVUNX
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
QW
Qwen3 Next 80B A3B MTP blk48 Q4 K M Sidecar
Qwen · Beer-Gut-Boomer
Params1.65B
Context—
Q4_K_M1.1 GB
GGUF
LF
LFM3 1.7B Opencode
Lfm · harness-hub
Params33M
Context—
Smallest0.1 GB
GGUF
MI
mistral 7b professional law Q8 0
Mistral · Sleem247
Params42M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing