InternLM GGUF models

329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Q4_K_M5.4 GB
CodingRoleplay
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
CodingVision
IN
Internlm2_5 Step Prover
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · ZeroWw
Params8.8B
Context32K
Smallest5.7 GB
GGUF
IN
InternLM2StepProver
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
GGUF
IN
OREAL 32B
InternLM · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
IN
OREAL 7B
InternLM · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
IN
Internlm2_5 7b Chat 1m
InternLM · newsletter
Params7.74B
Context256K
Smallest6.4 GB
GGUF
IN
Internlm Internlm2_5 7b
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
GGUF
IN
Intern S1
InternLM · noctrex
Params235B
Context64K
Smallest129.3 GB
ReasoningTool useVision
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest3.8 GB
Coding
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest6.4 GB
GGUF
IN
Internlm2_5 7b Chat Abliterated
InternLM · byroneverson
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
lumynax reasoning internlm3 8b
InternLM · AbteeXAILab
Params8.8B
Context32K
Q4_K_M5.4 GB
Reasoning
IN
CapRL 3B Q4 0
InternLM · introvoyz041
Params3.09B
Context125K
Smallest1.8 GB
Tool useVision
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest9.7 GB
GGUF
IN
CapRL InternVL3.5 8B
InternLM · earth-demon
Params8.19B
Context40K
Smallest8.7 GB
Vision
IN
InternLM2
InternLM · mcgrady164
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat Abliterated
InternLM · pegasus912
Params7.74B
Context32K
Smallest6.4 GB
GGUF
IN
Intern S2 397B
InternLM · 42ailab
Params403B
Context256K
Smallest98.1 GB
ReasoningTool use
IN
Internlm Internlm2 1_8b
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.4 GB
CodingRoleplay
IN
InternLM2
InternLM · Felladrin
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · itlwas
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
Internlm2_5 20b Chat Abliterated
InternLM · byroneverson
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
IN
internlm2 5 1 8b
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
IN
Internlm2_5 20b Chat Abliterated
InternLM · win10
Params19.9B
Context32K
Smallest16.3 GB
GGUF
IN
Internlm2.5_7B_Distill
InternLM · juneup
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF

Keep browsing