Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
my model gguf 1
Model · danieltorscho
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
MO
model
Model · seaskyccl
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Model123
Model · Crystalhavanvo
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model merged pp Q3 K M
Model · emrd95
Params23.6B
Context32K
Smallest11.5 GB
GGUF
MO
Model gguf baru Q4
Model · nazalanala
Params3.21B
Context128K
Smallest2.0 GB
Tool use
MO
model
Model · Chaer
Params14.8B
Context32K
Smallest15.7 GB
Tool use
MO
model
Model · pangluo
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
Model1
Model · Midni4ht
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · emulk
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Model2
Model · Thor12321
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
Model Emailcampaign
Model · gawyria
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model
Model · hermawandx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · YuebaiTQ
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
MO
model
Model · ST4
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
MO
model
Model · johaanm
Params8.03B
Context8K
Smallest16.1 GB
GGUF
MO
model
Model · Alonv
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model
Model · MaxKappa
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model f16
Model · miketan1234
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · davirolim
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model
Model · bokil
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · dawsondavis
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model cn
Model · iveryo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · yuwang0318
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model QA medical 2024
Model · thviet79
Params7.29B
Context32K
Smallest14.6 GB
GGUF
MO
model
Model · mazingj5
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
Model_X_V3_Merged
Model · sandepaAI
Params308M
Context512
Smallest0.6 GB
GGUF
MO
model1
Model · bayeshan
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model3
Model · bayeshan
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · siksdad
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MO
20241012 model q4km
Model · Kreisinator
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing