Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · phuma
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model q4 k m
Model · reaper24
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · gary320
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · kyrieiii
Params3.21B
Context128K
Smallest3.4 GB
MO
model unsloth.Q4 K M
Model · yonischeyer
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
model1
Model · milerx4
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · facanogo
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · hrihell
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model
Model · chaymaa2004
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · iggym
Params8.03B
Context128K
Smallest8.5 GB
MO
model4
Model · leekh7624
Params8.03B
Context8K
Smallest8.5 GB
MO
model
Model · weibb
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · jc0316
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · rick22630773
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
ds model
Model · Ailoveu
Params7.62B
Context128K
Smallest8.1 GB
MO
model 1
Model · Peaceuai
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · chhutney
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · yuhsuan327
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · ZRX1Raziel
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
Model15
Model · ewoody
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model_1B_train
Model · Alyssa12375
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · Poroman
Params14.8B
Context32K
Q4_K_M9.0 GB
MO
model
Model · ITPITD
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model_sara_hf_16b
Model · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
MO
model
Model · Hannan2004
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · haidangung
Params14.8B
Context40K
Smallest20.4 GB
MO
model.push to hub
Model · dylim
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model3B 100k
Model · StefanDaniels1
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · user0117
Params9.2B
Context256K
Q4_K_M5.8 GB
MO
qm_model_7B_q4bit
Model · xtc2023
Params7.62B
Context128K
Smallest8.1 GB