Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · JonasHFA
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · ibmjian
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model q4
Model · Avvis
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · korean-lightweight-ai
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MO
model
Model · uITimeCia
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model
Model · Sahil2507
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
MO
AM model new
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model merged pp Q8 0
Model · emrd95
Params23.6B
Context32K
Smallest25.1 GB
GGUF
MO
Model_Pmc_Beta_0.1_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
Model_Pmc_Kl_0.1_Noise0_0_Epoch2
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
Model_8B_V2
Model · better11lyh
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
model gguf q4
Model · Ashilion
Params3.21B
Context128K
Smallest2.0 GB
Tool use
MO
model
Model · mew151mew
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model1 sft
Model · jerrycheng233
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
gf3 model
Model · Stoops0311
Params8.19B
Context40K
Smallest5.0 GB
ReasoningTool use
MO
model
Model · Bronotcoolll
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · ffw123
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · NUKE123123
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Model Nasgor
Model · filzarizki
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · hariom-jha01
Params3.21B
Context128K
Q4_K_M0.9 GB
GGUF
MO
model
Model · saucyg
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
Model_V3_Finetuned_Final
Model · pangluo
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
my model
Model · venomsap
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
MO
model
Model · pkfire13
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model
Model · damning
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · wick8073
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · leodaspra
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model unsloth.F16
Model · tyruan
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · vivi168
Params17.3B
Context—
Smallest18.7 GB
GGUF
MO
model
Model · lobo017
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing