Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
F2LLM v2 0.6B
Llm · sabafallah
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
F2LLM v2 1.7B
Llm · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
llm jp 3 3.7b instruct EZO Common
Llm · ineair
Params3.78B
Context4K
Q4_K_M2.3 GB
GGUF
LL
d3LLM LLaDA
Llm · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
LL
llm4decompile 6.7b uo
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
llm4decompile 6.7b
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
LLM as Judge LFM
Llm · NEWWWWWbie
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
LL
llm4decompile 33b
Llm · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
LL
Llm Jp 4 8b Thinking
Llm · alfredplpl
Params8.59B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
LL
Llm 350m Instruct v2
Llm · mradermacher
Params322M
Context2K
Q4_K_M0.2 GB
Tool use
LL
Llm Jp 3 8x13b Instruct3
Llm · mmnga
Params73.2B
Context4K
Q4_K_M45.4 GB
GGUF
LL
T3Q-LLM1-Solar-10.8B-v1.0
Llm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm-compiler-13b
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
LLM360 Amber
Llm · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
LLM4Binary llm4decompile 6.7b v2
Llm · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
llm-compiler-13b-ftd
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llm Jp 4 32b A3B Thinking
Llm · mmnga-o
Params32.1B
Context64K
Q4_K_M21.4 GB
ReasoningTool use
LL
T3Q LLM MG v1.0 i1
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 4 32b A3B Thinking
Llm · llm-jp
Params32.1B
Context64K
Q4_K_M21.4 GB
ReasoningTool use
LL
Llm Jp 4 33b Thinking
Llm · mmnga-o
Params33.2B
Context64K
Q4_K_M20.2 GB
ReasoningTool use
LL
T3Q LLM Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM v2 80M
Llm · mradermacher
Params80M
Context40K
Q4_K_M0.1 GB
ReasoningTool use
LL
Llm Jp 4 32b A3B Thinking
Llm · hiratagoh
Params32.1B
Context64K
Q4_K_M21.4 GB
ReasoningTool use
LL
llm-compiler-13b-ftd
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
llm4decompile 9b v2
Llm · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
GGUF
LL
chihoonlee10/T3Q-LLM2-sft1.0-dpo1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM v2 330M Q8 0
Llm · spelunk-cloud
Params334M
Context—
Smallest0.4 GB
GGUF
LL
llm4decompile 1.3b
Llm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
LLM-jp-4 8B Instruct
Llm · rinrin0413
Params8.59B
Context64K
Q4_K_M5.3 GB
Tool use

Keep browsing