InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Internlm2_5 20b Chat
InternLM · YorkieOH10
Params19.9B
Context32K
Smallest21.1 GB
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest9.7 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
IN
Internlm2_5 1_8b
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest9.4 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.4 GB
IN
Internlm2_5 7b Chat
InternLM · itlwas
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2 Chat 1_8b
InternLM · Edge-Quant
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
InternLM2
InternLM · YorkieOH10
Params7.74B
Context8K
Smallest8.2 GB
IN
Internlm2_5 1_8b Chat
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
OREAL 7B
InternLM · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest5.1 GB
IN
InternLM2
InternLM · Cran-May
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2 Chat 1_8b
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest10.6 GB
IN
InternLM2
InternLM · farpluto
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.3 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
Internlm2 Math 7b
InternLM · itlwas
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
Internlm2_5 20b
InternLM · itlwas
Params19.9B
Context256K
Q4_K_M12.0 GB
IN
internlm2_5-1_8b-chat
InternLM · mitulagr2
Params1.89B
Context32K
Smallest1.4 GB
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
internlm2 base 20b
InternLM · intervitens-archive
Params19.9B
Context32K
Smallest16.3 GB
IN
CPsyCounX
InternLM · Slipstream-Max
Params7.74B
Context32K
Smallest15.5 GB
IN
Internlm2.5_7B_Distill_Orpo
InternLM · juneup
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · dasChronos1
Params19.9B
Context32K
Smallest16.3 GB
IN
Intern-S1-Mini
InternLM · yarikdevcom
Params8.2B
Context40K
Q4_K_M5.0 GB
IN
Internlm2 Math Plus 7b
InternLM · Theta-Lev
Params7.74B
Context8K
Smallest8.2 GB