Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llm4Decompile 1.3b v2
Llm · Th3S
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
llmjp-dareties
Llm · aipib
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
LL
llmjp-slerp2
Llm · aipib
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
LL
T3Q-LLM/T3Q-LLM3-NC-v1.0
Llm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llm4decompile-1.3b-v1.5
Llm · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
T3Q LLM1 Sft1.0 Dpo1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM V2 8B
Llm · seamon67
Params7.57B
Context40K
Q4_K_M4.7 GB
CodingEmbeddingReasoning
LL
T3Q-LLM/T3Q-LLM2-CV-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm4decompile-1.3b-v2
Llm · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LL
F2LLM V2 4B
Llm · seamon67
Params4.02B
Context40K
Smallest4.3 GB
CodingEmbeddingReasoning
LL
PH LLM 0.5B
Llm · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llm Embedder
Llm · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Embedding
LL
LLM
Llm · zhuipiaochen
Params7.51B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Llm4Decompile 22b v2
Llm · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
llm-compiler-13b
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
llm4decompile 1.3b
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Coding
LL
T3Q-LLM/T3Q-LLM2-FP-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm-jp-13b-instruct-dolly-en-ja-oasst-v1.1
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-MK-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.4
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 3 1.8b
Llm · alfredplpl
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
LL
llm demo
Llm · jor-t
Params6M
Context256
Smallest0.0 GB
GGUF
LL
T3Q LLM1 CV v2.0 i1
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.2
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-CV-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Psychosis Speedrun
Llm · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
LL
F2LLM 1.7B
Llm · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llm4Decompile 22b v2
Llm · Th3S
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
Llm Embedder
Llm · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Embedding
LL
Tr Jp LLM 1.5B v2
Llm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Keep browsing