Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B HauhauCS Aggressive Q8 K P GGUF deploy mirror
Qwen · yiliankexi
Params27.3B
Context256K
Smallest31.5 GB
QW
Qwen3.8 27B Coder390 EfficientThink Q2LynnStyle P1M
Qwen · thebadking
Params26.1B
Context256K
Smallest12.4 GB
TE
tesseract frk
Tesseract · cstr
Params2M
Context—
Smallest0.0 GB
NL
nllb-200-distilled-1.3B
Nllb · keisuke-miyako
Params2.16B
Context—
Q4_K_M1.2 GB
AL
alltalk models
Alltalk · Raird2221
Params118M
Context—
Q4_K_M0.2 GB
TI
google/timesfm-2.5-200m-pytorch
Timesfm · amaye15
Params231M
Context—
Smallest0.2 GB
TO
BiRefNet toonout
Toonout · Acly
Params220M
Context—
Smallest0.4 GB
LL
LoRA Llama 3 70B Instruct Abliterated
Llama · ggml-org
Params424M
Context—
Smallest1.7 GB
RE
reinette custom
Reinette · Reinett3
Params41M
Context—
Smallest0.0 GB
LA
statim-decide-en-large
Laya · Beko2210
Params421M
Context—
Smallest0.5 GB
AN
anima turbo
Anima · asfdrwe
Params2.09B
Context—
Smallest0.3 GB
DH
c0ur4ge
Dhsx · 75dhsx2
Params11.9B
Context—
Smallest6.8 GB
GE
Gemma4 E2B Qwen3.8 Distilled
Gemma · bunnycore
Params25M
Context—
Smallest0.0 GB
QW
Qwen3.8 27B KTopt
Qwen · wiklif
Params16M
Context—
Smallest0.0 GB
TM
tmp keydrop
Tmp · asfsdfsa
Params—
Context—
Smallest0.0 GB
SM
SmolVLM 500M Instruct be
Smolvlm · VyoJ
Params409M
Context8K
Smallest0.4 GB
MO
pi05
Moyoyotech · MoYoYoTech
Params691M
Context—
Smallest0.0 GB
CH
chatterbox multilingual v3
Chatterbox · vokra
Params536M
Context—
Smallest2.1 GB
SM
RuCritic 3B
SmolLM · maks74581
Params30M
Context—
Smallest0.0 GB
MI
Mistral Nemo 12B abliterated LORA F16
Mistral · BernardHood
Params246M
Context—
Smallest0.5 GB
GE
gemma 26b Timberline lora
Gemma · oxpuppy635
Params19M
Context—
Smallest0.0 GB
GE
gemma 4 26B A4B it heretic ara lora
Gemma · Qwe1325
Params26B
Context—
Smallest0.0 GB
QW
LoRA Qwen2.5 3B Instruct Abliterated
Qwen · ggml-org
Params140M
Context—
Smallest0.6 GB
LL
MyceLM Llama 3.2 3B LoRA F16
Llama · andrasto
Params24M
Context—
Smallest0.0 GB
QW
Holo4 27B qwen3.8 27B svd lora
Qwen · hotdogs
Params452M
Context—
Smallest0.9 GB
TH
the largest model ever on hf
The · GGUFGuy
Params—
Context—
Smallest0.0 GB
KR
krea2 7sins
Krea · SEVUNX
Params12.8B
Context—
Q4_K_M7.9 GB
QW
Qwen3 Next 80B A3B MTP blk48 Q4 K M Sidecar
Qwen · Beer-Gut-Boomer
Params1.65B
Context—
Q4_K_M1.1 GB
LF
LFM3 1.7B Opencode
Lfm · harness-hub
Params33M
Context—
Smallest0.1 GB
MI
mistral 7b professional law Q8 0
Mistral · Sleem247
Params42M
Context—
Smallest0.1 GB