Ice GGUF models
180 GGUF models in the Ice family, quantized by 33 uploaders. Sizes run from 1.24B to 13B parameters. The longest trained context is 128K tokens.
IC
Ice0.128 15.06 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.100 20.03 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.147 17.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.7 29.09 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.41 22.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.104 22.04 RP ORPO i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.83 04.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.104 13.04 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.37 18.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.31 08.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.101 20.03 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.29 06.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.74 02.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.107 22.04 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.57 17.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.55 17.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.113 08.05 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.67 25.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.41 22.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.51 16.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.60 18.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.86 04.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.98 19.03 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.37 18.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.88 07.02 RP Dpo Merged_16Bit
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.101 20.03 RP
Ice · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
IC
Ice0.34n 14.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.101 20.03 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.123 28.05 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.91 14.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB