Ice GGUF models

180 GGUF models in the Ice family, quantized by 33 uploaders. Sizes run from 1.24B to 13B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IC
Ice_Refund
Ice · PAUL1122
Params3.21B
Context128K
Smallest3.4 GB
Tool use
IC
Ice0.105 13.04 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · sunghee74
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ice77
Ice · ksyang00
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.87 07.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · zinux
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.88 07.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice03
Ice · ohzero
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.65 25.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · PAUL1122
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ice2
Ice · objects76
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.77 02.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
Ice0.17 03.10 RP Q8 0
Ice · Ransss
Params7.24B
Context32K
Smallest7.7 GB
Roleplay
IC
Ice0.66 25.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · qtnn
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.68 25.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
Ice0.99 20.03 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
Ice2_Model
Ice · sbs1003
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ICE HARBIN
Ice · DZhiwen
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IC
ice3
Ice · ellinakim
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ice3
Ice · youngcho
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.123 28.05 RP IQ4 XS
Ice · icefog72
Params7.24B
Context32K
Smallest3.9 GB
Roleplay
IC
ice4
Ice · youngcho
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ice2
Ice · gabin1234
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.69 25.01 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · wootan76
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
ice
Ice · PAUL1122
Params3.21B
Context128K
Smallest3.4 GB
GGUF
IC
Ice0.123 28.05 RP Q4 K S
Ice · icefog72
Params7.24B
Context32K
Smallest4.1 GB
Roleplay
IC
Ice0.31 08.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IC
ice3
Ice · nalsil
Params3.21B
Context128K
Smallest3.4 GB
GGUF

Keep browsing