Llm GGUF models
309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.
LL
Llm4Decompile 1.3b v2
Llm · Th3S
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
llmjp-dareties
Llm · aipib
Params1.42B
Context2K
Q4_K_M0.9 GB
LL
llmjp-slerp2
Llm · aipib
Params1.42B
Context2K
Q4_K_M0.9 GB
LL
T3Q-LLM/T3Q-LLM3-NC-v1.0
Llm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llm4decompile-1.3b-v1.5
Llm · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
T3Q LLM1 Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
F2LLM V2 8B
Llm · seamon67
Params7.57B
Context40K
Q4_K_M4.7 GB
LL
T3Q-LLM/T3Q-LLM2-CV-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
llm4decompile-1.3b-v2
Llm · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
F2LLM V2 4B
Llm · seamon67
Params4.02B
Context40K
Smallest4.3 GB
LL
PH LLM 0.5B
Llm · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llm Embedder
Llm · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
LL
LLM
Llm · zhuipiaochen
Params7.51B
Context128K
Q4_K_M2.4 GB
LL
Llm4Decompile 22b v2
Llm · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
llm-compiler-13b
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
LL
llm4decompile 1.3b
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
T3Q-LLM/T3Q-LLM2-FP-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
llm-jp-13b-instruct-dolly-en-ja-oasst-v1.1
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
LL
T3Q-LLM/T3Q-LLM2-MK-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.4
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 3 1.8b
Llm · alfredplpl
Params1.87B
Context4K
Q4_K_M1.2 GB
LL
llm demo
Llm · jor-t
Params6M
Context256
Smallest0.0 GB
LL
T3Q LLM1 CV v2.0 i1
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.2
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
T3Q-LLM/T3Q-LLM2-CV-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Psychosis Speedrun
Llm · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
LL
F2LLM 1.7B
Llm · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
LL
Llm4Decompile 22b v2
Llm · Th3S
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
Llm Embedder
Llm · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
LL
Tr Jp LLM 1.5B v2
Llm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB