Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CR
crystal ball
Crystal · skeggsguy
Params62M
Context—
Smallest0.1 GB
GGUF
PH
adapter Phi 3 mini 4k instruct code writing
Phi · zhhan
Params25M
Context—
Smallest0.1 GB
GGUF
LA
Laguna XS.2 jlens
Laguna · gghfez
Params164M
Context—
Smallest0.3 GB
GGUF
GP
gpt oss 20b lawd F16
gpt-oss · DarwinAnim8or
Params32M
Context—
Smallest0.1 GB
GGUF
GE
gemma2 2b
Gemma · neta-art
Params2.62B
Context—
Smallest2.3 GB
GGUF
MI
Mistral 7B Teletype
Mistral · tiararodney
Params14M
Context—
Smallest0.1 GB
GGUF
LL
kbtg kpoint v1 fused
Llama · katopz
Params3.21B
Context128K
Smallest6.4 GB
GGUF
KR
krea2
Krea · wmueller
Params12.8B
Context—
Smallest14.6 GB
GGUF
QW
Qwen3 Next 80B A3B Thinking
Qwen · essigpeng
Params114M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek V4 Flash 0731 MXFP4
DeepSeek · Rabbit-Hole-Ai
Params284B
Context1024K
Smallest156.4 GB
GGUF
SP
speaker diarization community 1
Speaker · openresearchtools
Params7M
Context—
Smallest0.0 GB
GGUF
AN
AnimaYume
Animayume · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
GGUF
FA
Falcon3 7B Base 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
GGUF
SH
shader v2
Shader · Scorched2
Params325M
Context256
Smallest1.3 GB
GGUF
BI
hy mt2 1.8b discord 1.25bit lora
Bit · Jour
Params39M
Context—
Smallest0.0 GB
GGUF
HE
hermes rp l2 7b
Hermes · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
GGUF
QW
pflash request probe
Qwen · Lucebox
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6 27B MTP TENSORS ONLY
Qwen · tooltd
Params425M
Context—
Smallest0.2 GB
GGUF
MI
Attack Chain Simulator Mistral7B Lora
Mistral · techdj
Params14M
Context—
Smallest0.0 GB
GGUF
CR
crowd-anon
Crowd · NagaYu
Params110M
Context—
Smallest0.1 GB
GGUF
SC
scail 2
Scail · fwwrsd
Params16.4B
Context—
Q4_K_M11.5 GB
GGUF
GE
Gemma4 E2B Coding Distill
Gemma · bunnycore
Params101M
Context—
Smallest0.2 GB
GGUF
OC
PP-OCRv6_tiny_rec
Ocrv · mlx-community
Params1M
Context—
Smallest0.0 GB
GGUF
PI
pix2struct
Pix · cstr
Params282M
Context—
Smallest0.4 GB
GGUF
SR
SRA LLM i1
Sra · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
GR
Granite Uncertainty 3.2 8b Lora
Granite · QuantPanda
Params3M
Context—
Smallest0.0 GB
GGUF
WA
Wan SkyReels CausVid
Wan · Zuntan
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
QW
model cartidges
Qwen · mmaccrate
Params8M
Context—
Smallest0.0 GB
GGUF
FA
Falcon3 3B Instruct 1.58bit
Falcon · nebuxcloud
Params3.23B
Context—
Smallest1.2 GB
GGUF
OC
PP-OCRv6_medium_det
Ocrv · mlx-community
Params22M
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing