Llm GGUF models
309 GGUF models in the Llm family, quantized by 125 uploaders. Sizes run from 2M to 73.2B parameters. The longest trained context is 256K tokens.
LL
T3Q LLM1 CV v2.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
llm jp 4.1 33b systemone experimental
Llm · shunmoridev
Params33.2B
Context64K
Smallest23.6 GB
LL
llm
Llm · SDFASDGA
Params1.1B
Context512
Smallest0.3 GB
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
llm-jp-1.3b-v1.0
Llm · mmnga
Params1.42B
Context2K
Q4_K_M0.9 GB
LL
llm 350m instruct
Llm · sandbreak80sd
Params322M
Context2K
Q4_K_M0.2 GB
LL
LLM 3.2 1B
Llm · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
F2LLM V2 14B
Llm · seamon67
Params14B
Context40K
Q4_K_M8.6 GB
LL
T3Q LLM T3Q LLM1 CV v1.0
Llm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 4 33b Thinking
Llm · idxx
Params33.2B
Context64K
Q4_K_M20.2 GB
LL
LLM 8BI
Llm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
FN LLM
Llm · fnholding
Params1.72B
Context40K
Smallest3.4 GB
LL
llm medicalbot
Llm · surajvbangera
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llm models
Llm · akahana
Params2.61B
Context128K
Q4_K_M0.8 GB
LL
LLM_lama_3b_test
Llm · JeonGuKang
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
T3Q LLM T3Q LLM2 FP v2.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.3
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
F2LLM V2 1.7B
Llm · seamon67
Params1.72B
Context40K
Smallest1.8 GB
LL
llm
Llm · mrnfqrbl
Params33.3B
Context256K
Q4_K_M5.6 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.5
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 4 33b Thinking
Llm · WariHima
Params33.2B
Context64K
Q4_K_M20.2 GB
LL
my llm
Llm · harshkumar63
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llm4decompile 1.3b v1.5 copy
Llm · Deobfuscation
Params1.35B
Context16K
Smallest2.7 GB
LL
T3Q LLM2412 10.8B v1.0
Llm · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 3.1 1.8b Function Calling
Llm · aipib
Params1.87B
Context4K
Q4_K_M1.2 GB
LL
LLM training stock 8bit 200 steps
Llm · RushabhShah122000
Params8.03B
Context128K
Smallest8.5 GB
LL
llm.js
Llm · rahuldshetty
Params462M
Context1K
Q4_K_M0.3 GB
LL
llm-compiler-7b
Llm · Tech-Meld
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
F2LLM v2 330M
Llm · yeahbeen
Params334M
Context40K
Q4_K_M0.3 GB