InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Tiny Random Internlm2
InternLM · mradermacher
Params24M
Context128
Q4_K_M0.0 GB
GGUF
IN
Internlm2 Chat 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Chat 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm3 8B Nex N1
InternLM · mradermacher
Params8.8B
Context128K
Q4_K_M5.4 GB
Tool use
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
internlm3 8b it
InternLM · cortexso
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
Internlm Internlm2_5 1_8b Chat
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 Wqx 20b
InternLM · mradermacher
Params19.9B
Context4K
Q4_K_M12.0 GB
GGUF
IN
Patent Base InternLM2 7B Ties
InternLM · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
IN
Tiny Random Internlm2
InternLM · mradermacher
Params24M
Context128
Q4_K_M0.0 GB
GGUF
IN
Aculi InternLM2 Chat 20B ToxicRP
InternLM · RichardErkhov
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm Internlm2 Chat 7b Sft
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
GGUF
IN
InternLM2
InternLM · izumi04
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm Internlm2_5 20b
InternLM · tensorblock
Params19.9B
Context256K
Smallest7.5 GB
GGUF
IN
Internlm3 8B Nex N1
InternLM · mradermacher
Params8.8B
Context128K
Q4_K_M5.4 GB
Tool use
IN
Internlm2_5 1_8b Chat
InternLM · lmstudio-community
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
OREAL 7B SFT
InternLM · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest11.3 GB
GGUF
IN
Internlm Chatbode 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat 1m
InternLM · gaianet
Params7.74B
Context256K
Q4_K_M4.7 GB
Coding
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · lmstudio-community
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
IN
OpenSafetyLab MD Judge V0_2 Internlm2_7B
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
GGUF
IN
Internlm Internlm2_5 7b Chat 1m
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
GGUF
IN
InternLM_2_5 7b_LR
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest10.6 GB
GGUF
IN
Internlm SWE Fixer Retriever 7B
InternLM · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingTool use
IN
Internlm2_5 20b Chat
InternLM · gaianet
Params19.9B
Context32K
Q4_K_M12.0 GB
Coding

Keep browsing