InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
CapRL Eval 3B
InternLM · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
IN
Internlm2 Chat 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
DPO Internlm2 1 8B
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2 Chat 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · Felladrin
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
internlm.OREAL 7B
InternLM · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
Jeff 2b_export
InternLM · jersobh
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
IN
Internlm2_5 20b Chat Abliterated
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm.Internlm3 8b Instruct
InternLM · DevQuasar-8
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
OpenSafetyLab.MD Judge V0_2 Internlm2_7B
InternLM · DevQuasar-3
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
internlm/SWE-Fixer-Retriever-7B
InternLM · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
Internlm2 Chat 7b Sft
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
JanusCoder 8B
InternLM · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingReasoningTool use
IN
Internlm2 Chat 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · lmstudio-community
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · internlm
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · gaianet
Params7.74B
Context32K
Q4_K_M4.7 GB
Coding
IN
InternS1-235b
InternLM · internlm
Params235B
Context40K
Smallest250.0 GB
ReasoningTool useVision
IN
InternLM2
InternLM · nold
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm Internlm2 Math Plus 1_8b
InternLM · tensorblock
Params1.89B
Context8K
Smallest0.8 GB
GGUF
IN
JanusCoder 14B
InternLM · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
IN
Internlm3 8b Instruct
InternLM · mradermacher
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · gaianet
Params8.8B
Context32K
Q4_K_M5.4 GB
Coding
IN
Internlm2 20b
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
intern decision 4b tool gate v0.22.0
InternLM · renlu
Params4.21B
Context256K
Smallest0.0 GB
GGUF
IN
Internlm2 Chat 20b Sft
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Intern-S1-Mini
InternLM · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing