InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Internlm2_5 1_8b Chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.1 GB
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest5.5 GB
IN
Internlm2_5 7b Chat
InternLM · Nicholas55555
Params7.74B
Context32K
Smallest8.2 GB
IN
Internlm2_5 1_8b Chat
InternLM · Kondara
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
JanusCoder 8B
InternLM · TimesLast
Params8.19B
Context32K
Q4_K_M5.0 GB
IN
InternLM 3 8B PowerServe QNN29 8G3
InternLM · PowerServe
Params8B
Context32K
Smallest0.0 GB
IN
Internlm2 Math 20b
InternLM · itlwas
Params19.9B
Context8K
Q4_K_M12.0 GB
IN
Stellaris internlm2 20b r512 Q4 K S
InternLM · AIgotahole
Params19.9B
Context32K
Smallest11.4 GB
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
IN
Internlm2_5 7b
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
Internlm2_5 7b Chat 1m
InternLM · Kondara
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
Internlm2 20b
InternLM · Sarrusha
Params19.9B
Context32K
Smallest14.1 GB
IN
Internlm2_5 1_8b
InternLM · Kondara
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm2_5 7b Chat 1m
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
XTuner_InternLM
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Tiny Random Internlm2
InternLM · tensorblock
Params24M
Context128
Smallest0.0 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest7.2 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.0 GB
IN
InternLM2
InternLM · Wusul
Params19.9B
Context4K
Smallest14.1 GB
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · win10
Params19.9B
Context32K
Smallest16.3 GB
IN
InternLM2
InternLM · Zachary-Gao
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm Internlm2_5 1_8b
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
IN
InternLM2
InternLM · QiyuWu
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
InternLM2
InternLM · QiyuWu
Params1.89B
Context32K
Smallest1.1 GB
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Smallest4.5 GB
IN
JanusCoder 8B
InternLM · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Smallest8.2 GB
IN
InternLM2
InternLM · wei-bing
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Vega QwQ 7B Q5K S
InternLM · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB