InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Visual ERM
InternLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
IN
Internlm2 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
JanusCoderV 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
IN
Internlm2 Wqx 20b
InternLM · mradermacher
Params19.9B
Context4K
Q4_K_M12.0 GB
GGUF
IN
Intern Decision 4B
InternLM · yeaay
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
IN
JanusCoderV 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Coding
IN
InternLM2
InternLM · lmstudio-community
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
InternLM2-Chat-20B-ToxicRP
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Spatial SSRL 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
IN
internlm2-limarp-chat-20b
InternLM · RichardErkhov
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
CapRL Eval 3B i1
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool use
IN
InternLM2
InternLM · bartowski
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Chat 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
internlm chatbode 20b
InternLM · recogna-nlp
Params19.9B
Context32K
Q4_K_M11.4 GB
GGUF
IN
Internlm3 8b Instruct Abliterated
InternLM · mradermacher
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
ShieldLM 7B Internlm2
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
ComfyChat InternLM2 7b v2 1
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · second-state
Params8.8B
Context32K
Q4_K_M5.4 GB
Coding
IN
CapRL 3B
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
IN
ShieldLM 7B Internlm2
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
internlm2 5 1 8b chat
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
Internlm2 Chat 20b Sft
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
OREAL 32B
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
IN
OREAL 32B SFT
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
IN
OREAL 7B
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use

Keep browsing