InternLM GGUF models
329 GGUF models in the InternLM family, quantized by 76 uploaders. Sizes run from 24M to 403B parameters. The longest trained context is 256K tokens.
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
JanusCoder 14B
InternLM · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
IN
Internlm2_5 Step Prover
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
IN
Internlm3 8b Instruct
InternLM · ZeroWw
Params8.8B
Context32K
Smallest5.7 GB
IN
InternLM2StepProver
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
IN
OREAL 32B
InternLM · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
OREAL 7B
InternLM · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
Internlm2_5 7b Chat 1m
InternLM · newsletter
Params7.74B
Context256K
Smallest6.4 GB
IN
Internlm Internlm2_5 7b
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
IN
Intern S1
InternLM · noctrex
Params235B
Context64K
Smallest129.3 GB
IN
AlchemistCoder-DS-6.7B
InternLM · NikolayKozloff
Params6.74B
Context16K
Smallest3.8 GB
IN
InternLM2
InternLM · NikolayKozloff
Params7.74B
Context8K
Smallest6.4 GB
IN
Internlm2_5 7b Chat Abliterated
InternLM · byroneverson
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2 7b
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
lumynax reasoning internlm3 8b
InternLM · AbteeXAILab
Params8.8B
Context32K
Q4_K_M5.4 GB
IN
CapRL 3B Q4 0
InternLM · introvoyz041
Params3.09B
Context125K
Smallest1.8 GB
IN
InternLM2
InternLM · NikolayKozloff
Params19.9B
Context8K
Smallest9.7 GB
IN
CapRL InternVL3.5 8B
InternLM · earth-demon
Params8.19B
Context40K
Smallest8.7 GB
IN
InternLM2
InternLM · mcgrady164
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
Internlm2_5 7b Chat Abliterated
InternLM · pegasus912
Params7.74B
Context32K
Smallest6.4 GB
IN
Intern S2 397B
InternLM · 42ailab
Params403B
Context256K
Smallest98.1 GB
IN
Internlm Internlm2 1_8b
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.4 GB
IN
InternLM2
InternLM · Felladrin
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm2_5 20b Chat
InternLM · itlwas
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
Internlm2_5 20b Chat Abliterated
InternLM · byroneverson
Params19.9B
Context32K
Q4_K_M12.0 GB
IN
internlm2 5 1 8b
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
IN
Internlm2_5 20b Chat Abliterated
InternLM · win10
Params19.9B
Context32K
Smallest16.3 GB
IN
Internlm2.5_7B_Distill
InternLM · juneup
Params7.74B
Context32K
Q4_K_M4.7 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB