GGUF models: wtfpl license

94 GGUF models listed under the wtfpl license on Hugging Face. Always read the license text before commercial use. Sizes run from 38M to 123B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 Amakuro i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BL
BlackXorDolphTronGOAT
Blackxordolphtrongoat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MambaHermes-3B
Mambahermes · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
Tool use
EB
eblangpt falos67
Eblangpt · EBLANSoft
Params—
Context64
Smallest0.0 GB
GGUF
FI
Fithah
Fithah · 4eJIoBek
Params125M
Context2K
Smallest0.1 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v5
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LI
IlyaGusev/T-lite-instruct-0.1-abliterated
Lite · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
MambaHermes 3B
Mambahermes · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
Tool use
BE
35b beta long
Beta · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
Tool use
CA
CausalLM 14B DPO alpha
Causallm · AIMERgzr
Params14.2B
Context8K
Q4_K_M9.2 GB
Tool useVision
CA
causallm_14b
yunmoq
Params14.2B
Context8K
Smallest8.2 GB
Tool useVision
MI
YuisekinAI Mistral 0.3B
Mistral · mradermacher
Params355M
Context4K
Q4_K_M0.2 GB
GGUF
QW
Qwen2.5 3B Instruct Reticent
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
XO
XORTRON-NXTXPRT7-FAST
Xortron · darkc0de
Params34.7B
Context256K
Smallest28.0 GB
ReasoningTool use
LT
LTX Video
Ltx · tsqn
Params1.92B
Context—
Smallest0.8 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v6
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TA
Tarnished 9b
Tarnished · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CA
CausalLM 14B DPO alpha
Causallm · zihuiliu7737
Params14.2B
Context8K
Q4_K_M9.2 GB
Tool useVision
SO
soil gemini
Soil · denxxs
Params2.51B
Context8K
Smallest10.0 GB
GGUF
BE
CausalLM 35b-beta-long
Beta · NeoChen1024
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
XO
XORTRON.CriminalComputing.larger
Xortron · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
SO
denxxs/soil-gemini
Soil · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
PU
PurpleStatic
Purplestatic · LocalWisdom
Params103M
Context2K
Q4_K_M0.1 GB
Embedding
AL
D:\alpaca-native-enhanced-7b\alpaca-7b-nativeEnhanced
Alpaca · Pi3141
Params6.74B
Context2K
Smallest2.8 GB
GGUF
CA
CausalLM 14B
Causallm · Limour
Params14.2B
Context8K
Smallest5.0 GB
GGUF
LL
Llama 3.1 8b Instruct Ortho v7
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LI
T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CA
Causallm 22B Merge
Causallm · DisOOM
Params22B
Context8K
Q4_K_M14.3 GB
GGUF

Keep browsing