InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
Spatial SSRL 7B
InternLM · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · legraphista
Params1.89B
Context32K
Smallest0.5 GB
GGUF
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
AlchemistCoder L 7B
InternLM · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
IN
OREAL 7B
InternLM · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
Internlm2 Math 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Intern Decision 4B
InternLM · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · internlm
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Intern Decision 2B
InternLM · bombdefuser-124
Params1.88B
Context256K
Smallest2.0 GB
ReasoningTool useVision
IN
Internlm2_5 1_8b Chat
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Januscoder-14B
InternLM · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
IN
InternLM2StepProver
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
MD Judge V0_2 Internlm2_7B
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
GGUF
IN
InternLM2
InternLM · second-state
Params7.74B
Context32K
Q4_K_M4.7 GB
Coding
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · lmstudio-community
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
JanusCoder 14B
InternLM · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
IN
Internlm3 8b Instruct
InternLM · mradermacher
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · gaianet
Params1.89B
Context32K
Q4_K_M1.2 GB
Coding

Keep browsing