Llm GGUF models
309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.
LL
F2LLM v2 0.6B
Llm · sabafallah
Params596M
Context40K
Q4_K_M0.4 GB
LL
F2LLM v2 1.7B
Llm · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
LL
llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
LL
llm jp 3 3.7b instruct EZO Common
Llm · ineair
Params3.78B
Context4K
Q4_K_M2.3 GB
LL
d3LLM LLaDA
Llm · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
LL
llm4decompile 6.7b uo
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
llm4decompile 6.7b
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
LLM as Judge LFM
Llm · NEWWWWWbie
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
llm4decompile 33b
Llm · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
LL
Llm Jp 4 8b Thinking
Llm · alfredplpl
Params8.59B
Context64K
Q4_K_M5.3 GB
LL
Llm 350m Instruct v2
Llm · mradermacher
Params322M
Context2K
Q4_K_M0.2 GB
LL
Llm Jp 3 8x13b Instruct3
Llm · mmnga
Params73.2B
Context4K
Q4_K_M45.4 GB
LL
T3Q-LLM1-Solar-10.8B-v1.0
Llm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
llm-compiler-13b
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
LL
LLM360 Amber
Llm · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
LLM4Binary llm4decompile 6.7b v2
Llm · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
llm-compiler-13b-ftd
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llm Jp 4 32b A3B Thinking
Llm · mmnga-o
Params32.1B
Context64K
Q4_K_M21.4 GB
LL
T3Q LLM MG v1.0 i1
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 4 32b A3B Thinking
Llm · llm-jp
Params32.1B
Context64K
Q4_K_M21.4 GB
LL
Llm Jp 4 33b Thinking
Llm · mmnga-o
Params33.2B
Context64K
Q4_K_M20.2 GB
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
F2LLM v2 80M
Llm · mradermacher
Params80M
Context40K
Q4_K_M0.1 GB
LL
Llm Jp 4 32b A3B Thinking
Llm · hiratagoh
Params32.1B
Context64K
Q4_K_M21.4 GB
LL
llm-compiler-13b-ftd
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
LL
llm4decompile 9b v2
Llm · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
LL
chihoonlee10/T3Q-LLM2-sft1.0-dpo1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
F2LLM v2 330M Q8 0
Llm · spelunk-cloud
Params334M
Context—
Smallest0.4 GB
LL
llm4decompile 1.3b
Llm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
LLM-jp-4 8B Instruct
Llm · rinrin0413
Params8.59B
Context64K
Q4_K_M5.3 GB