InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Intern Decision 0.8B
InternLM · bombdefuser-124
Params752M
Context256K
Smallest0.8 GB
IN
Internlm2_5 20b Chat Abliterated
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
InternLM2-Chat-20B-ToxicRP
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm Internlm2_5 7b Chat
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
IN
JanusCoder 8B
InternLM · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
IN
Internlm2_5 7b Chat 1m
InternLM · second-state
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
IN
OREAL 7B
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context256K
Q4_K_M4.7 GB
IN
MD Judge V0_2 Internlm2_7B
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
OREAL 32B SFT
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
OREAL 32B
InternLM · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context256K
Smallest1.9 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
internlm2_5-1_8b-chat
InternLM · internlm
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
CapRL Video 4B
InternLM · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
IN
internlm2_5-20b-chat
InternLM · internlm
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2_5 20b Chat
InternLM · second-state
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
AlchemistCoder L 7B
InternLM · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
IN
Intern-S1-Mini
InternLM · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
IN
Internlm Chatbode 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
AlchemistCoder-DS-6.7B
InternLM · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
IN
Internlm2_5 20b Chat
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2_5 7b Chat Abliterated
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2 Chat 7b Sft
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
CapRL 3B i1
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
IN
Internlm2_5 7b Chat Abliterated
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · duyntnet
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2_5 1_8b Chat
InternLM · second-state
Params1.89B
Context32K
Q4_K_M1.2 GB