Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llm4Decompile 22b v2
Llm · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
llm 3 2 flux prompt
Llm · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
GGUF
LL
F2LLM v2 0.6B
Llm · yuvytung
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
F2LLM v2 80M
Llm · yuvytung
Params80M
Context40K
Q4_K_M0.1 GB
ReasoningTool use
LL
Llm Jp 4 8b Thinking
Llm · mmnga-o
Params8.59B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
LL
F2LLM v2 330M
Llm · yuvytung
Params334M
Context40K
Q4_K_M0.3 GB
ReasoningTool use
LL
llm4decompile 6.7b v1.5
Llm · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
GGUF
LL
F2LLM v2 4B
Llm · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
LL
LLM4Binary.llm4decompile 6.7b v2
Llm · DevQuasar-7
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
F2LLM v2 8B
Llm · mradermacher
Params7.57B
Context40K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llm4Decompile 22b v2
Llm · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
llm jp 3.1 1.8b v02b
Llm · ago99
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
LL
LLM AI Server
Llm · mmkurodan
Params2M
Context128
Q4_K_M0.0 GB
GGUF
LL
llm4decompile-1.3b
Llm · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
Llm Jp 4 8b Thinking Uncensored Ara HF
Llm · RumiaChannel
Params8.59B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
LL
llm-jp-13b-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
llm-compiler-7b
Llm · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
T3Q LLM Product T3Q LLM2 Solar 10.7B v1.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm4decompile 6.7b v2 Q4 K M
Llm · Th3S
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
F2LLM v2 0.6B
Llm · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
llm-compiler-7b-ftd
Llm · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
genpatsu ai 8b
Llm · kukutan
Params8.59B
Context64K
Q4_K_M5.3 GB
GGUF
LL
Llm Jp 4 Kappa 32b A3B v0.1
Llm · mmnga-o
Params32.1B
Context64K
Q4_K_M21.4 GB
GGUF
LL
d3LLM LLaDA i1
Llm · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
LL
Llm Jp 4 Vl 9b
Llm · tokinasin
Params8.59B
Context64K
Q4_K_M5.3 GB
Vision
LL
Llm Vn 1 7b
Llm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
llm4decompile 6.7b nsp
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
f2llm v2 0.6b
Llm · cstr
Params596M
Context40K
Smallest0.4 GB
Embedding
LL
llm jp 3 3.7b instruct EZO Humanities
Llm · ineair
Params3.78B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing