Experiment GGUF models

393 GGUF models in the Experiment family, quantized by 20 uploaders. Sizes run from 3.09B to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
EX
Experiment20 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment28M7_T3qM7
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26 7B passthrough 6slice
Experiment · babybirdprd
Params7B
Context—
Q4_K_M3.2 GB
GGUF
EX
Experiment28T3q_Inex16Calme
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26T3qm7xp_Inex12Strangemerges_32
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26Yam_Experiment27Inex12
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26Yamshadow_Experiment26Experiment24
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment28M7_Ognoexperiment27M7
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26Yamshadow_YamNeuralsirkrishna
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26Strangemerges 32 7B
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
L3.3_RP_Experiment
Experiment · Sicarius-Prototyping
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
EX
Experiment26Yam_Multi_verse_modelM7
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment31 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment1
Experiment · qa-02
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
EX
Yam Peleg Experiment26 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
EX
Experiment2
Experiment · qa-02
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
EX
Experiment28T3q_Experiment27Inex12
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26Yamshadow_Neuralsirkrishnaexperiment26Experiment24
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment26 7B Dareties
Experiment · babybirdprd
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment30 7B Q4 K M
Experiment · hus960
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment28M7_Experiment28Strangemerges_32
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment1
Experiment · Kobubu
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
EX
experiment26 mistroll slerp
Experiment · giannisan
Params7.24B
Context32K
Smallest7.7 GB
GGUF
EX
Experiment28 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment30 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment22 7B
Experiment · RichardErkhov
Params7B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment15 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
GGUF
EX
Experiment Bw A3
Experiment · lainlives
Params3.09B
Context32K
Smallest3.3 GB
Tool use
EX
Experiment23 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Experiment24 7B
Experiment · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing