Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
ppuuttyy/llm-project
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-FP-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm-jp-13b-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
LL
llm
Llm · humair025
Params96M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llm_Coder_V1_Gguf
Llm · Roquier
Params3.09B
Context32K
Smallest1.9 GB
CodingTool use
LL
T3Q-LLM-Product/T3Q-LLM2-Solar-10.7B-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
leekanghoun1/llm_exercise
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLM4Binary.llm4decompile 1.3b v2
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
Llm Jp 3 13b
Llm · alfredplpl
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM 4B
Llm · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
LL
llm wizard mergekit ties qxitski
Llm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llm jp 3.1 8x13b instruct4
Llm · mmnga
Params73.2B
Context4K
Q4_K_M45.4 GB
GGUF
LL
Llm Jp 3 3.7b
Llm · alfredplpl
Params3.78B
Context4K
Q4_K_M2.3 GB
GGUF
LL
LLM Adaptive ZMath Model 32B
Llm · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
LL
Asagi vlm
Llm · aipib
Params1.87B
Context4K
Smallest0.8 GB
CodingVision
LL
llm-jp-3-3.7b-Open-R1-Distill
Llm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
LL
LLM4Binary Llm4Decompile 1.3b v2
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
LL
llm4decompile 6.7b v2
Llm · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
GGUF
LL
llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
chihoonlee10/T3Q-LLM-MG-DPO-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Vn 1 7b
Llm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
F2LLM 0.6B
Llm · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
Llm Jp 4.1 8b Thinking
Llm · masahiroid
Params8.59B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
LL
F2LLM v2 4B Q8A64
Llm · VelociQ8
Params4.15B
Context40K
Smallest4.2 GB
GGUF
LL
llm wizard mergekit ties xvxbphx
Llm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llm4decompile 9b v2 Q4 K M
Llm · kexplo
Params8.83B
Context128K
Q4_K_M5.3 GB
GGUF
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
Llm Jp 4 32b A3B Thinking
Llm · ash2813
Params32.1B
Context64K
Q4_K_M21.5 GB
ReasoningTool use
LL
Llm Jp 4 8b Instruct
Llm · mosh-hf
Params8.59B
Context64K
Q4_K_M5.3 GB
Tool use

Keep browsing