Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
llm test
Llm · jl917
Params494M
Context32K
Smallest1.0 GB
Tool use
LL
LLM
Llm · ujjwalmehla
Params1.24B
Context128K
Smallest0.8 GB
Tool use
LL
llm hpc finetuned
Llm · temp1122
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
LL
Llm0308 Hf
Llm · kopoYH
Params3.88B
Context128K
Smallest7.8 GB
GGUF
LL
llm
Llm · p101111
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
llm
Llm · Elroist
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
LL
llm
Llm · sbhadauriya33537
Params7.24B
Context32K
Smallest5.1 GB
GGUF
LL
LLM
Llm · vbanonyme
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LL
llm eeg analyser 4bit
Llm · youslam
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing