Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
Model_Q4_K_M
Model · vnyaryan
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model
Model · HeyItsAustin25
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · JACM
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · BimaP
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · youngkiyoon
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · cvllvc
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · danishppatel
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · JasperRoy
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model1
Model · q631599119
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · LuvazAng
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model9
Model · ewoody
Params3.21B
Context128K
Smallest1.5 GB
Tool use
MO
model2
Model · neurosynced
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · atunGrande
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MO
model merged pp Q5 K M
Model · emrd95
Params23.6B
Context32K
Smallest16.8 GB
GGUF
MO
model
Model · norio
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model 3.2.2
Model · tso2
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
Model_7B_V1
Model · better11lyh
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
MO
Model2
Model · Simone999111
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · lovicho
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model 3 alpha phase
Model · Terisara
Params3.21B
Context128K
Smallest2.3 GB
GGUF
MO
model
Model · bikashoza
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
Model_Pmc_Kl_0.1_Noise0_0_Epoch1
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
my model
Model · nathens
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
MO
model
Model · Yuldoctor
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · lehuaaa
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model q4 k m
Model · lipizza
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · oloflil
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
Model_1B
Model · gzsol
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model
Model · huliyato
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MO
my model
Model · dbrider
Params8.03B
Context128K
Smallest8.5 GB
GGUF

Keep browsing