Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · hongaha
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
v3 model
Model · coltlinzheng9201
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MO
AM model together2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
AM model qw TQ
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model 02
Model · softgood
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · acomplexname
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · YellowLeaves
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Model1
Model · Okkarkyaw
Params1.24B
Context128K
Smallest2.5 GB
Tool use
MO
model test01
Model · HLXchamp
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model Q8 0
Model · rmsdud
Params84M
Context—
Smallest0.3 GB
GGUF
MO
1112 model 1500
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
Model2
Model · sharon8811
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
AM model qw S
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · rokeybanngmorng
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
model
Model · kelvenray
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model
Model · ashutoshkorde
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · vlbandara
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
AM model qw Q
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model 3
Model · Peaceuai
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model name abliterated
Model · Hugwarrior
Params3.76B
Context32K
Q4_K_M7.2 GB
GGUF
MO
model
Model · kozhaaai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Model V1 Cot
Model · FarhanAkhtar
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model_q8_0
Model · juniormj1
Params7.25B
Context32K
Smallest7.7 GB
Coding
MO
AM model qw Q T
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · BulBulMan
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Model_Gguf
Model · anish12
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MO
Model_3B_Q4
Model · sagarmeshram
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · ibrahkadabra
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model4 dapo
Model · jerrycheng233
Params8.19B
Context320K
Smallest8.7 GB
ReasoningTool use
MO
model unsloth.Q4 K M V3.2
Model · RyanLee1229
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing