Llm GGUF models

309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LL
T3Q LLM1 CV v2.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
llm jp 4.1 33b systemone experimental
Llm · shunmoridev
Params33.2B
Context64K
Smallest23.6 GB
Reasoning
LL
llm
Llm · SDFASDGA
Params1.1B
Context512
Smallest0.3 GB
GGUF
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
llm-jp-1.3b-v1.0
Llm · mmnga
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
LL
llm 350m instruct
Llm · sandbreak80sd
Params322M
Context2K
Q4_K_M0.2 GB
GGUF
LL
LLM 3.2 1B
Llm · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
F2LLM V2 14B
Llm · seamon67
Params14B
Context40K
Q4_K_M8.6 GB
CodingEmbeddingReasoning
LL
T3Q LLM T3Q LLM1 CV v1.0
Llm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 4 33b Thinking
Llm · idxx
Params33.2B
Context64K
Q4_K_M20.2 GB
ReasoningTool use
LL
LLM 8BI
Llm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
FN LLM
Llm · fnholding
Params1.72B
Context40K
Smallest3.4 GB
GGUF
LL
llm medicalbot
Llm · surajvbangera
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
llm models
Llm · akahana
Params2.61B
Context128K
Q4_K_M0.8 GB
GGUF
LL
LLM_lama_3b_test
Llm · JeonGuKang
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q LLM T3Q LLM2 FP v2.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.3
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
F2LLM V2 1.7B
Llm · seamon67
Params1.72B
Context40K
Smallest1.8 GB
CodingEmbeddingReasoning
LL
llm
Llm · mrnfqrbl
Params33.3B
Context256K
Q4_K_M5.6 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-sft1.5
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 4 33b Thinking
Llm · WariHima
Params33.2B
Context64K
Q4_K_M20.2 GB
ReasoningTool use
LL
my llm
Llm · harshkumar63
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
llm4decompile 1.3b v1.5 copy
Llm · Deobfuscation
Params1.35B
Context16K
Smallest2.7 GB
GGUF
LL
T3Q LLM2412 10.8B v1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 3.1 1.8b Function Calling
Llm · aipib
Params1.87B
Context4K
Q4_K_M1.2 GB
Tool use
LL
LLM training stock 8bit 200 steps
Llm · RushabhShah122000
Params8.03B
Context128K
Smallest8.5 GB
Tool use
LL
llm.js
Llm · rahuldshetty
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
LL
llm-compiler-7b
Llm · Tech-Meld
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
F2LLM v2 330M
Llm · yeahbeen
Params334M
Context40K
Q4_K_M0.3 GB
EmbeddingReasoningTool use

Keep browsing