Llm GGUF models
309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.
LL
llm jp 1.3b v1.0 staircaptions FT
Llm · taoki
Params1.42B
Context2K
Q4_K_M0.9 GB
LL
llm quantized models
Llm · neka-nat
Params72.3B
Context4K
Q4_K_M8.3 GB
LL
F2LLM v2 330M
Llm · mradermacher
Params334M
Context40K
Q4_K_M0.3 GB
LL
llm jp 1.8bx24 combined
Llm · mmnga
Params26.2B
Context4K
Q4_K_M15.9 GB
LL
F2LLM v2 0.6B Q8A64
Llm · VelociQ8
Params621M
Context40K
Smallest0.6 GB
LL
Llm Jp 4 32b A3B Thinking
Llm · alfredplpl
Params32.1B
Context64K
Q4_K_M21.4 GB
LL
LLM Adaptive ZMath Model 32B
Llm · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
LL
f2llm v2 80m
Llm · cstr
Params80M
Context—
Smallest0.1 GB
LL
Llm4Decompile 6.7b v1.6
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
LLM4Binary.llm4decompile 1.3b v1.5
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
llm-compiler-7b
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
F2LLM v2 330M Q8A64
Llm · VelociQ8
Params351M
Context40K
Smallest0.4 GB
LL
Llm4Decompile 1.3b v1.6
Llm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
T3Q-LLM/T3Q-LLM2-CP-v1.1
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
F2LLM v2 8B Q8A64
Llm · VelociQ8
Params8B
Context40K
Smallest7.8 GB
LL
LLM4Binary.llm4decompile 9b v2
Llm · DevQuasar-7
Params8.83B
Context128K
Q4_K_M5.3 GB
LL
F2LLM v2 160M
Llm · mradermacher
Params159M
Context40K
Q4_K_M0.2 GB
LL
llm-jp-13b-instruct-full-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
LL
llm-compiler-7b-ftd
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
LLM4Binary llm4decompile 6.7b v1.5
Llm · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
T3Q LLM T3Q LLM2 FP v1.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 3 13b
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
LL
T3Q LLM MG v1.0
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
LLM4Binary Llm4Decompile 1.3b v1.5
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
llm compiler 13b ftd
Llm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
LL
f2llm v2 330m
Llm · cstr
Params334M
Context—
Smallest0.3 GB
LL
T3Q LLM MG DPO v1.0
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
LLM4Binary Llm4Decompile 22b v2
Llm · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
LL
f2llm v2 160m
Llm · cstr
Params159M
Context—
Smallest0.1 GB