Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
Llm Embedder
Llm · itskoi
Params109M
Context512
Q4_K_M0.1 GB
Embedding
LL
llm jp 3 7b
Llm · yasunai
Params3.78B
Context4K
Smallest7.6 GB
GGUF
LL
LLM 3.1 8B Instruct
Llm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLM4CH2DE
Llm · JuliusJu572
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
LLM jp 4 33B
Llm · ryujis
Params33.2B
Context64K
Q4_K_M20.2 GB
Tool use
LL
T3Q LLM MG DPO v1.0
Llm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
jz llm test lora
Llm · coltlinzheng9201
Params40M
Context—
Smallest0.2 GB
GGUF
LL
llm-compiler-7b-ftd
Llm · aifeifei798
Params6.74B
Context16K
Smallest4.8 GB
GGUF
LL
h20LLM Q4 K M
Llm · anthonymeo
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
LL
LLM
Llm · abdulrehman77
Params1.24B
Context128K
Smallest2.5 GB
CodingTool use
LL
LLM241111
Llm · SK11120
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Tr-Jp-LLM-1.5B-v2-dolly
Llm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
my llm model
Llm · njrfbnjrkef
Params1.78B
Context32K
Smallest0.8 GB
Tool use
LL
LLM2411121
Llm · SK11120
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
T3Q LLM1 CV v2.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
llm training
Llm · chrisnb1
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
T3Q LLM T3Q LLM1 CV v2.0
Llm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
My LLM Learning
Llm · genchangp
Params3.82B
Context4K
Smallest3.1 GB
GGUF
LL
LLM pie3 model
Llm · kramit624
Params3.82B
Context4K
Smallest2.4 GB
GGUF
LL
my llm 7B
Llm · mjcarleb
Params6.74B
Context2K
Smallest7.2 GB
GGUF
LL
LLM matefi
Llm · miladatefi
Params1.1B
Context2K
Smallest0.8 GB
GGUF
LL
llm fine tuned for grammar
Llm · greenie-sweden
Params1.24B
Context128K
Q4_K_M1.3 GB
Tool use
LL
llm
Llm · Tobius
Params—
Context8K
Smallest0.0 GB
GGUF
LL
LLM_class
Llm · chotony
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
LLM_class2
Llm · chotony
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
llm model
Llm · aarushidhyani
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LL
llm gguf v2
Llm · Tobius
Params—
Context8K
Smallest0.0 GB
GGUF
LL
llm internal 1
Llm · pavankumarag
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
T3Q LLM2 FP v1.0
Llm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
llm
Llm · qazljlj
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use

Keep browsing