Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
A3LLM
Llm · tghurair
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
llm bazi
Llm · Adzpro
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
LL
T3Q-LLM/T3Q-LLM2-sft1.1
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm 350m instruct v2
Llm · sandbreak80sd
Params322M
Context2K
Q4_K_M0.2 GB
Tool use
LL
h20LLM Q8 0
Llm · anthonymeo
Params1.83B
Context8K
Smallest1.9 GB
GGUF
LL
llm jp 4 chatml return beta1
Llm · SousiOmine
Params8.59B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
LL
H LLM LOCAL
Llm · sdasdawq234
Params7.5B
Context128K
Smallest3.7 GB
Vision
LL
LLM4Decompile SFT Deobfuscate v0.1.1 test 20epochs
Llm · Deobfuscation
Params1.35B
Context16K
Smallest1.4 GB
GGUF
LL
llm files
Llm · gabor-hosu
Params838M
Context1K
Smallest0.3 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.0-dpo1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 3 1.8b
Llm · keisuke-miyako
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
LL
LLM4Decompile SFT Deobfuscate v0.1.1 test 20epochs lr1e 3
Llm · Deobfuscation
Params1.35B
Context16K
Smallest1.4 GB
GGUF
LL
llm-compiler-13b
Llm · aifeifei798
Params13B
Context16K
Smallest9.2 GB
GGUF
LL
llm jp 3 1.8B
Llm · Atotti
Params1.87B
Context4K
Smallest3.7 GB
GGUF
LL
qu llm assistant allam
Llm · qassim-university
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
LL
jz llm hobbie v2
Llm · coltlinzheng9201
Params7.62B
Context128K
Smallest15.2 GB
GGUF
LL
LLM CAFE
Llm · JoaoReiz
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
LL
T3Q-LLM/T3Q-LLM2-sft1.6
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLM training stock new
Llm · RushabhShah122000
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
A3LLM Q 2.5
Llm · tghurair
Params3.09B
Context32K
Smallest6.2 GB
Tool use
LL
A3LLM q 2.5 8bit
Llm · tghurair
Params3.09B
Context32K
Smallest3.3 GB
Tool use
LL
LLM 3.2
Llm · ar08
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
llm powered de pipeline model
Llm · lkhhoe94
Params1.24B
Context128K
Smallest1.3 GB
GGUF
LL
LLM Models
Llm · ArunKr
Params70.6B
Context8K
Smallest4.9 GB
GGUF
LL
llm4decompile 6.7b uo ggml f16
Llm · sajattack
Params6.74B
Context8K
Smallest13.5 GB
GGUF
LL
T3Q LLM3 NC v1.0
Llm · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
LLM_securityV1_GGUF
Llm · hyunwoo612
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
LLM FQL LogScale
Llm · samifares
Params8.03B
Context128K
Smallest16.1 GB
GGUF
LL
LLM
Llm · Hishambarakat
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llm Jp 3 3.7b
Llm · keisuke-miyako
Params3.78B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing