InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2 Chat 1_8b
InternLM · Solshine
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest8.8 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest5.1 GB
CodingRoleplay
IN
Internlm2_5 20b
InternLM · Kondara
Params19.9B
Context256K
Q4_K_M12.0 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.7 GB
CodingRoleplay
IN
Internlm2_5 7b Chat
InternLM · BenevolenceMessiah
Params7.74B
Context32K
Smallest8.2 GB
GGUF
IN
internlm2_5-1_8b-chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.4 GB
GGUF
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context256K
Smallest6.5 GB
GGUF
IN
internlm chat 20b
InternLM · intervitens-archive
Params20.1B
Context4K
Q4_K_M12.2 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · zelk12
Params7.74B
Context32K
Smallest6.4 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params1.89B
Context8K
Smallest2.0 GB
GGUF
IN
intern rp lora
InternLM · ToastyPigeon
Params8.8B
Context32K
Smallest9.4 GB
CodingRoleplay
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingVision
IN
Internlm2 Chat 7b Sft
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
GGUF
IN
InternLM2
InternLM · Cran-May
Params7.74B
Context32K
Smallest4.2 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · ijohn07
Params7.74B
Context32K
Smallest3.0 GB
GGUF
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest10.5 GB
CodingVision
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · hellork
Params7.74B
Context32K
Smallest4.5 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest3.5 GB
CodingRoleplay
IN
InternLM2
InternLM · brittlewis12
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 20b
InternLM · NikolayKozloff
Params19.9B
Context256K
Smallest8.8 GB
GGUF
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context32K
Smallest6.5 GB
GGUF
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest4.7 GB
Coding
IN
InternLM2
InternLM · ClaudioItaly
Params7.74B
Context256K
Smallest5.5 GB
GGUF
IN
InternLM 3 8B PowerServe QNN29 8G4
InternLM · PowerServe
Params8B
Context32K
Smallest0.0 GB
GGUF
IN
internlm2 5 7b chat Q8 0
InternLM · Aashraf995
Params7.74B
Context32K
Smallest8.2 GB
GGUF
IN
Internlm Internlm2 Chat 1_8b Sft
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · newsletter
Params1.89B
Context32K
Smallest1.6 GB
GGUF

Keep browsing