Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model13b
Model · ankushag
Params13B
Context2K
Smallest10.7 GB
GGUF
MO
model teste
Model · diegmbtavares
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model merged pp Q6 K
Model · emrd95
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MO
Model 4
Model · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
MO
model
Model · bryanwuu
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
Model Crty 20b
Model · crtypubg
Params268M
Context32K
Smallest0.5 GB
GGUF
MO
Model_Test
Model · bluleap
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MO
model
Model · xensive
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · DjordjeAMK
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model gguf dos vuln
Model · missamehdi
Params—
Context—
Smallest0.0 GB
GGUF
MO
model ley21719
Model · cyanezjo
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
MO
Model Toweco 7B
Model · Mikhail2023
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MO
model 1.8b
Model · XinNuyoah
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
MO
model
Model · bucunzai2
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
t5 ft model Q8 0
Model · mrbutter
Params—
Context512
Smallest0.0 GB
GGUF
MO
model
Model · wychuw
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
MO
Model1
Model · Thor12321
Params8.03B
Context128K
Smallest14.6 GB
GGUF
MO
my model collection
Model · Rayquaza04
Params219M
Context—
Smallest0.1 GB
GGUF
MO
me model on server
Model · vikas-patel-iph
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MO
model
Model · hacker333
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model1
Model · Gillioxl
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
a2mn model
Model · bibhabasu11
Params4.63B
Context128K
Smallest3.3 GB
ReasoningTool use
MO
my model
Model · devswithme
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
MO
model2
Model · cyanezjo
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool useVision
MO
model
Model · UrMomIsFat56
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model
Model · pranav910
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · dz85512
Params1.24B
Context128K
Smallest1.3 GB
GGUF
MO
Model_V3_Finetuned
Model · pangluo
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
Hf_Model
Model · Ram00007
Params7.25B
Context32K
Smallest7.7 GB
GGUF
MO
model ya2
Model · n0rmis
Params8.04B
Context32K
Smallest8.5 GB
GGUF

Keep browsing