InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2_5 20b Chat
InternLM · YorkieOH10
Params19.9B
Context32K
Smallest21.1 GB
GGUF
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest9.7 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
CodingRoleplay
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
CodingRoleplay
IN
Internlm2_5 1_8b
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest9.4 GB
CodingRoleplay
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.4 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · itlwas
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Chat 1_8b
InternLM · Edge-Quant
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · YorkieOH10
Params7.74B
Context8K
Smallest8.2 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
OREAL 7B
InternLM · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
Tool use
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest5.1 GB
CodingRoleplay
IN
InternLM2
InternLM · Cran-May
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Chat 1_8b
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest10.6 GB
GGUF
IN
InternLM2
InternLM · farpluto
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.3 GB
CodingRoleplay
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Math 7b
InternLM · itlwas
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 20b
InternLM · itlwas
Params19.9B
Context256K
Q4_K_M12.0 GB
GGUF
IN
internlm2_5-1_8b-chat
InternLM · mitulagr2
Params1.89B
Context32K
Smallest1.4 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
internlm2 base 20b
InternLM · intervitens-archive
Params19.9B
Context32K
Smallest16.3 GB
GGUF
IN
CPsyCounX
InternLM · Slipstream-Max
Params7.74B
Context32K
Smallest15.5 GB
GGUF
IN
Internlm2.5_7B_Distill_Orpo
InternLM · juneup
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · dasChronos1
Params19.9B
Context32K
Smallest16.3 GB
GGUF
IN
Intern-S1-Mini
InternLM · yarikdevcom
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
IN
Internlm2 Math Plus 7b
InternLM · Theta-Lev
Params7.74B
Context8K
Smallest8.2 GB
GGUF

Keep browsing