InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Visual ERM
InternLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
IN
Internlm2 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
JanusCoderV 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
IN
Internlm2 Wqx 20b
InternLM · mradermacher
Params19.9B
Context4K
Q4_K_M12.0 GB
IN
Intern Decision 4B
InternLM · yeaay
Params4.21B
Context256K
Q4_K_M2.7 GB
IN
JanusCoderV 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · lmstudio-community
Params19.9B
Context8K
Q4_K_M12.0 GB
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
InternLM2-Chat-20B-ToxicRP
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Spatial SSRL 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
IN
internlm2-limarp-chat-20b
InternLM · RichardErkhov
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2_5 7b Chat
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
CapRL Eval 3B i1
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
Internlm2 Chat 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
internlm chatbode 20b
InternLM · recogna-nlp
Params19.9B
Context32K
Q4_K_M11.4 GB
IN
Internlm3 8b Instruct Abliterated
InternLM · mradermacher
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
ShieldLM 7B Internlm2
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
ComfyChat InternLM2 7b v2 1
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm3 8b Instruct
InternLM · second-state
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
CapRL 3B
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
IN
ShieldLM 7B Internlm2
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
internlm2 5 1 8b chat
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
IN
Internlm2 Chat 20b Sft
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
OREAL 32B
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
OREAL 32B SFT
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
OREAL 7B
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB