Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · hongaha
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
v3 model
Model · coltlinzheng9201
Params1.54B
Context32K
Q4_K_M1.0 GB
MO
AM model together2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
AM model qw TQ
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model 02
Model · softgood
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · acomplexname
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · YellowLeaves
Params8.03B
Context128K
Smallest8.5 GB
MO
Model1
Model · Okkarkyaw
Params1.24B
Context128K
Smallest2.5 GB
MO
model test01
Model · HLXchamp
Params8.03B
Context128K
Smallest8.5 GB
MO
model Q8 0
Model · rmsdud
Params84M
Context—
Smallest0.3 GB
MO
1112 model 1500
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
MO
Model2
Model · sharon8811
Params3.09B
Context32K
Q4_K_M1.9 GB
MO
AM model qw S
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model
Model · rokeybanngmorng
Params3.09B
Context32K
Smallest3.3 GB
MO
model
Model · kelvenray
Params3.09B
Context32K
Q4_K_M1.9 GB
MO
model
Model · ashutoshkorde
Params3.21B
Context128K
Smallest6.4 GB
MO
model
Model · vlbandara
Params3.09B
Context32K
Smallest3.3 GB
MO
AM model qw Q
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model 3
Model · Peaceuai
Params3.21B
Context128K
Smallest3.4 GB
MO
model name abliterated
Model · Hugwarrior
Params3.76B
Context32K
Q4_K_M7.2 GB
MO
model
Model · kozhaaai
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Model V1 Cot
Model · FarhanAkhtar
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model_q8_0
Model · juniormj1
Params7.25B
Context32K
Smallest7.7 GB
MO
AM model qw Q T
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model
Model · BulBulMan
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Model_Gguf
Model · anish12
Params1.72B
Context40K
Q4_K_M1.1 GB
MO
Model_3B_Q4
Model · sagarmeshram
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · ibrahkadabra
Params8.03B
Context128K
Smallest16.1 GB
MO
model4 dapo
Model · jerrycheng233
Params8.19B
Context320K
Smallest8.7 GB
MO
model unsloth.Q4 K M V3.2
Model · RyanLee1229
Params8.03B
Context8K
Q4_K_M4.9 GB