InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Internlm2 Base 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM3 8B Instruct
InternLM · DuoNeural
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
Internlm2 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
InternLM2
InternLM · PrunaAI
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
JanusCoder 8B
InternLM · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm.Internlm2_5 7b Chat
InternLM · DevQuasar-7
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · RichardErkhov
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
OREAL 32B
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
OREAL 7B SFT
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
ComfyChat InternLM2 1 8b v2 1
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Intern S1
InternLM · lmstudio-community
Params235B
Context40K
Q4_K_M142.7 GB
IN
internlm2 20b
InternLM · BoloniniD
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2_5 7b Chat Abliterated
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
internlm.OREAL 32B SFT
InternLM · DevQuasar-7
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
Internlm2 Chat 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
InternLM2
InternLM · bartowski
Params19.9B
Context8K
Q4_K_M12.0 GB
IN
MD Judge V0_2 Internlm2_7B
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2 Base 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
internLM
InternLM · Aculi
Params19.9B
Context32K
Smallest7.5 GB
IN
Internlm2 Chat 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2 Chat 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
CapRL InternVL3.5 8B
InternLM · Jobaar
Params8.19B
Context40K
Q4_K_M5.0 GB
IN
Internlm2_5 1_8b Chat
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
AlchemistCoder-L-7B
InternLM · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
IN
Patent Instruct Internlm2 7B Ties
InternLM · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
IN
Internlm3 8b Instruct Abliterated
InternLM · mradermacher
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB