Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · priyanshumadhup05
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model
Model · SaberMolaei
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model
Model · SuyashKirti96
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model200
Model · Gwizzly
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · CAI2001
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
my model
Model · abhi0127
Params1.42B
Context2K
Smallest2.8 GB
CodingVision
MO
model test 3
Model · SuyashKirti96
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Model4 Gguf
Model · sharon8811
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · farikaw599
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model2
Model · eybro
Params3.82B
Context128K
Q4_K_M2.3 GB
Tool use
MO
Model_Pmc_Kl_0.1_Noise0.1_0.1_Epoch1
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model Q4 K M
Model · fabian6567
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · GXZ8
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · i5clj
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MO
model
Model · phillychi3
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model vault
Model · HentaiP
Params12.8B
Context—
Q4_K_M7.2 GB
GGUF
MO
model
Model · LBerthalon
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model Stock Mixv0.1 7B i1
Model · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Model_Pmc_Kl_0.1_Noise0.1_0.1_Epoch0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
R_Model
Model · farikaw599
Params3.82B
Context4K
Smallest7.6 GB
GGUF
MO
Qm_Model_8B
Model · xtc2023
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MO
model 1120
Model · lendy0
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · eybro
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
rp model E2B v5.1
Model · 3fou34jfioqjf3q0pf
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
MO
Model_Pmc_Gamma_0.1_Noise0.2_0.2_Epoch1
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model
Model · ArunKr
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
MO
RikoteMaster Model_Openqa
Model · tensorblock
Params596M
Context40K
Smallest0.3 GB
GGUF
MO
model
Model · Chetan-k-p
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · yashraj121
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MO
model
Model · pramattale
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing