InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2_5 1_8b Chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.1 GB
GGUF
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
CodingVision
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest5.5 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · Nicholas55555
Params7.74B
Context32K
Smallest8.2 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · Kondara
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
JanusCoder 8B
InternLM · TimesLast
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingVision
IN
InternLM 3 8B PowerServe QNN29 8G3
InternLM · PowerServe
Params8B
Context32K
Smallest0.0 GB
GGUF
IN
Internlm2 Math 20b
InternLM · itlwas
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
IN
Stellaris internlm2 20b r512 Q4 K S
InternLM · AIgotahole
Params19.9B
Context32K
Smallest11.4 GB
GGUF
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
Internlm2_5 7b
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat 1m
InternLM · Kondara
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 20b
InternLM · Sarrusha
Params19.9B
Context32K
Smallest14.1 GB
GGUF
IN
Internlm2_5 1_8b
InternLM · Kondara
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 7b Chat 1m
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
IN
XTuner_InternLM
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Tiny Random Internlm2
InternLM · tensorblock
Params24M
Context128
Smallest0.0 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest7.2 GB
CodingRoleplay
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.0 GB
CodingRoleplay
IN
InternLM2
InternLM · Wusul
Params19.9B
Context4K
Smallest14.1 GB
GGUF
IN
InternLM2_5 20B ArliAI RPMax v1.1
InternLM · win10
Params19.9B
Context32K
Smallest16.3 GB
GGUF
IN
InternLM2
InternLM · Zachary-Gao
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm Internlm2_5 1_8b
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
InternLM2
InternLM · QiyuWu
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
InternLM2
InternLM · QiyuWu
Params1.89B
Context32K
Smallest1.1 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Smallest4.5 GB
GGUF
IN
JanusCoder 8B
InternLM · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
CodingVision
IN
Internlm2_5 7b Chat
InternLM · dumyy
Params7.74B
Context32K
Smallest8.2 GB
GGUF
IN
InternLM2
InternLM · wei-bing
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Vega QwQ 7B Q5K S
InternLM · IntelligentEstate
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use

Keep browsing