InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Intern Decision 0.8B
InternLM · bombdefuser-124
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
IN
Internlm2_5 20b Chat Abliterated
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
InternLM2-Chat-20B-ToxicRP
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm Internlm2_5 7b Chat
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
GGUF
IN
JanusCoder 8B
InternLM · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingReasoningTool use
IN
Internlm2_5 7b Chat 1m
InternLM · second-state
Params7.74B
Context256K
Q4_K_M4.7 GB
Coding
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
Vision
IN
OREAL 7B
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
InternLM2
InternLM · bartowski
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
MD Judge V0_2 Internlm2_7B
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
OREAL 32B SFT
InternLM · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
IN
OREAL 32B
InternLM · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
IN
InternLM2
InternLM · legraphista
Params7.74B
Context256K
Smallest1.9 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
internlm2_5-1_8b-chat
InternLM · internlm
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
CapRL Video 4B
InternLM · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool useVision
IN
internlm2_5-20b-chat
InternLM · internlm
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · second-state
Params19.9B
Context32K
Q4_K_M12.0 GB
Coding
IN
AlchemistCoder L 7B
InternLM · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
IN
Intern-S1-Mini
InternLM · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
IN
Internlm Chatbode 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
AlchemistCoder-DS-6.7B
InternLM · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
IN
Internlm2_5 20b Chat
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 7b Chat Abliterated
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Chat 7b Sft
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
CapRL 3B i1
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool use
IN
Internlm2_5 7b Chat Abliterated
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · duyntnet
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · second-state
Params1.89B
Context32K
Q4_K_M1.2 GB
Coding

Keep browsing