Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
CR
crystal ball
Crystal · skeggsguy
Params62M
Context—
Smallest0.1 GB
PH
adapter Phi 3 mini 4k instruct code writing
Phi · zhhan
Params25M
Context—
Smallest0.1 GB
LA
Laguna XS.2 jlens
Laguna · gghfez
Params164M
Context—
Smallest0.3 GB
GP
gpt oss 20b lawd F16
gpt-oss · DarwinAnim8or
Params32M
Context—
Smallest0.1 GB
GE
gemma2 2b
Gemma · neta-art
Params2.62B
Context—
Smallest2.3 GB
MI
Mistral 7B Teletype
Mistral · tiararodney
Params14M
Context—
Smallest0.1 GB
LL
kbtg kpoint v1 fused
Llama · katopz
Params3.21B
Context128K
Smallest6.4 GB
KR
krea2
Krea · wmueller
Params12.8B
Context—
Smallest14.6 GB
QW
Qwen3 Next 80B A3B Thinking
Qwen · essigpeng
Params114M
Context—
Smallest0.5 GB
DE
DeepSeek V4 Flash 0731 MXFP4
DeepSeek · Rabbit-Hole-Ai
Params284B
Context1024K
Smallest156.4 GB
SP
speaker diarization community 1
Speaker · openresearchtools
Params7M
Context—
Smallest0.0 GB
AN
AnimaYume
Animayume · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
FA
Falcon3 7B Base 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
SH
shader v2
Shader · Scorched2
Params325M
Context256
Smallest1.3 GB
BI
hy mt2 1.8b discord 1.25bit lora
Bit · Jour
Params39M
Context—
Smallest0.0 GB
HE
hermes rp l2 7b
Hermes · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
QW
pflash request probe
Qwen · Lucebox
Params—
Context—
Smallest0.0 GB
QW
Qwen3.6 27B MTP TENSORS ONLY
Qwen · tooltd
Params425M
Context—
Smallest0.2 GB
MI
Attack Chain Simulator Mistral7B Lora
Mistral · techdj
Params14M
Context—
Smallest0.0 GB
CR
crowd-anon
Crowd · NagaYu
Params110M
Context—
Smallest0.1 GB
SC
scail 2
Scail · fwwrsd
Params16.4B
Context—
Q4_K_M11.5 GB
GE
Gemma4 E2B Coding Distill
Gemma · bunnycore
Params101M
Context—
Smallest0.2 GB
OC
PP-OCRv6_tiny_rec
Ocrv · mlx-community
Params1M
Context—
Smallest0.0 GB
PI
pix2struct
Pix · cstr
Params282M
Context—
Smallest0.4 GB
SR
SRA LLM i1
Sra · mradermacher
Params40M
Context—
Smallest0.2 GB
GR
Granite Uncertainty 3.2 8b Lora
Granite · QuantPanda
Params3M
Context—
Smallest0.0 GB
WA
Wan SkyReels CausVid
Wan · Zuntan
Params16.4B
Context—
Q4_K_M10.8 GB
QW
model cartidges
Qwen · mmaccrate
Params8M
Context—
Smallest0.0 GB
FA
Falcon3 3B Instruct 1.58bit
Falcon · nebuxcloud
Params3.23B
Context—
Smallest1.2 GB
OC
PP-OCRv6_medium_det
Ocrv · mlx-community
Params22M
Context—
Smallest0.0 GB