Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · phuma
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model q4 k m
Model · reaper24
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · gary320
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · kyrieiii
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model unsloth.Q4 K M
Model · yonischeyer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
model1
Model · milerx4
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · facanogo
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · hrihell
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · chaymaa2004
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · iggym
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model4
Model · leekh7624
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · weibb
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · jc0316
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · rick22630773
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
ds model
Model · Ailoveu
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
MO
model 1
Model · Peaceuai
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model
Model · chhutney
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · yuhsuan327
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · ZRX1Raziel
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model15
Model · ewoody
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model_1B_train
Model · Alyssa12375
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · Poroman
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MO
model
Model · ITPITD
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model_sara_hf_16b
Model · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
MO
model
Model · Hannan2004
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · haidangung
Params14.8B
Context40K
Smallest20.4 GB
ReasoningTool use
MO
model.push to hub
Model · dylim
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model3B 100k
Model · StefanDaniels1
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · user0117
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
MO
qm_model_7B_q4bit
Model · xtc2023
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use

Keep browsing