Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llm jp 1.3b v1.0 staircaptions FT
Llm · taoki
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
LL
llm quantized models
Llm · neka-nat
Params72.3B
Context4K
Q4_K_M8.3 GB
GGUF
LL
F2LLM v2 330M
Llm · mradermacher
Params334M
Context40K
Q4_K_M0.3 GB
ReasoningTool use
LL
llm jp 1.8bx24 combined
Llm · mmnga
Params26.2B
Context4K
Q4_K_M15.9 GB
GGUF
LL
F2LLM v2 0.6B Q8A64
Llm · VelociQ8
Params621M
Context40K
Smallest0.6 GB
GGUF
LL
Llm Jp 4 32b A3B Thinking
Llm · alfredplpl
Params32.1B
Context64K
Q4_K_M21.4 GB
ReasoningTool use
LL
LLM Adaptive ZMath Model 32B
Llm · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
LL
llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
f2llm v2 80m
Llm · cstr
Params80M
Context—
Smallest0.1 GB
GGUF
LL
Llm4Decompile 6.7b v1.6
Llm · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
LLM4Binary.llm4decompile 1.3b v1.5
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
llm-compiler-7b
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
F2LLM v2 330M Q8A64
Llm · VelociQ8
Params351M
Context40K
Smallest0.4 GB
GGUF
LL
Llm4Decompile 1.3b v1.6
Llm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-CP-v1.1
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM v2 8B Q8A64
Llm · VelociQ8
Params8B
Context40K
Smallest7.8 GB
GGUF
LL
LLM4Binary.llm4decompile 9b v2
Llm · DevQuasar-7
Params8.83B
Context128K
Q4_K_M5.3 GB
GGUF
LL
F2LLM v2 160M
Llm · mradermacher
Params159M
Context40K
Q4_K_M0.2 GB
ReasoningTool use
LL
llm-jp-13b-instruct-full-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
LL
llm-compiler-7b-ftd
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
LLM4Binary llm4decompile 6.7b v1.5
Llm · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
T3Q LLM T3Q LLM2 FP v1.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 3 13b
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
LL
T3Q LLM MG v1.0
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLM4Binary Llm4Decompile 1.3b v1.5
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
LL
llm compiler 13b ftd
Llm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
f2llm v2 330m
Llm · cstr
Params334M
Context—
Smallest0.3 GB
GGUF
LL
T3Q LLM MG DPO v1.0
Llm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLM4Binary Llm4Decompile 22b v2
Llm · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
GGUF
LL
f2llm v2 160m
Llm · cstr
Params159M
Context—
Smallest0.1 GB
GGUF

Keep browsing