Llm GGUF models
309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.
LL
ppuuttyy/llm-project
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
T3Q-LLM/T3Q-LLM2-FP-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
llm-jp-13b-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
LL
llm
Llm · humair025
Params96M
Context1K
Q4_K_M0.1 GB
LL
Llm_Coder_V1_Gguf
Llm · Roquier
Params3.09B
Context32K
Smallest1.9 GB
LL
T3Q-LLM-Product/T3Q-LLM2-Solar-10.7B-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
leekanghoun1/llm_exercise
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
LLM4Binary.llm4decompile 1.3b v2
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Llm Jp 3 13b
Llm · alfredplpl
Params13.7B
Context4K
Q4_K_M8.3 GB
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
F2LLM 4B
Llm · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
LL
llm wizard mergekit ties qxitski
Llm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llm jp 3.1 8x13b instruct4
Llm · mmnga
Params73.2B
Context4K
Q4_K_M45.4 GB
LL
Llm Jp 3 3.7b
Llm · alfredplpl
Params3.78B
Context4K
Q4_K_M2.3 GB
LL
LLM Adaptive ZMath Model 32B
Llm · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Asagi vlm
Llm · aipib
Params1.87B
Context4K
Smallest0.8 GB
LL
llm-jp-3-3.7b-Open-R1-Distill
Llm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
LLM4Binary Llm4Decompile 1.3b v2
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
llm4decompile 6.7b v2
Llm · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
LL
llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
LL
chihoonlee10/T3Q-LLM-MG-DPO-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Vn 1 7b
Llm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
F2LLM 0.6B
Llm · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
LL
Llm Jp 4.1 8b Thinking
Llm · masahiroid
Params8.59B
Context64K
Q4_K_M5.3 GB
LL
F2LLM v2 4B Q8A64
Llm · VelociQ8
Params4.15B
Context40K
Smallest4.2 GB
LL
llm wizard mergekit ties xvxbphx
Llm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llm4decompile 9b v2 Q4 K M
Llm · kexplo
Params8.83B
Context128K
Q4_K_M5.3 GB
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
Llm Jp 4 32b A3B Thinking
Llm · ash2813
Params32.1B
Context64K
Q4_K_M21.5 GB
LL
Llm Jp 4 8b Instruct
Llm · mosh-hf
Params8.59B
Context64K
Q4_K_M5.3 GB