Open GGUF models
117 GGUF models in the Open family, quantized by 36 uploaders. Sizes run from 135M to 65B parameters. The longest trained context is 128K tokens.
OP
Open Hermes 2.5 neural chat 3.1 InterlaceMerge 14b
Open · S4sch
Params14.2B
Context32K
Smallest10.0 GB
OP
Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b
Open · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
OP
Open StaMis stock
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Q25M 1.5B Open R1 55k SFT v0.1
Open · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
OP
timberrific/open-bio-med-merge
Open · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
Open LLongMA 3B
Open · Aryanne
Params3.43B
Context8K
Smallest2.0 GB
OP
Open Gpt4 8x7B v0.2 q8 0
Open · rombodawg
Params46.7B
Context32K
Smallest49.6 GB
OP
open neo.Kyro n1 3B
Open · csabakecskemeti
Params3.09B
Context32K
Q4_K_M1.9 GB
OP
Open_Maid_Samantha_Hermes_Orca
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open_Gpt4_8x7B
Open · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
OP
Open Reasoner Zero 32B
Open · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
OP
Open_Gpt4_8x7B_v0.2
Open · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
OP
open hermes sd finetune erot story
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open Hermes 2.5 neural chat 3.1 frankenmerge 11b gguf q8
Open · S4sch
Params11.4B
Context32K
Smallest8.3 GB
OP
open neo.Kyro n1 7B
Open · DevQuasar-8
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
Open1 1.5B Instruct
Open · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
OP
Open RS3
Open · ysn-rfd
Params1.78B
Context128K
Smallest1.1 GB
OP
open jobs
Open · Vibe-Bataklik
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
Open Hermes 2.5 neural chat 3.1 frankenmerge 11b
Open · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
OP
Open Reasoner Zero 1.5B
Open · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
OP
Open StaMis v02 stock
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
open bio med merge
Open · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OP
Open Orca OpenOrca Preview1 13B
Open · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
OP
OPEN SOLAR KO 10.7B Dpo v1
Open · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
OP
Yi Ko 6B
Open · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
OP
Open-RS-DR_GRPO-8B
Open · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
OPEN KO SOLAR 10.7B gguf dpo hansoldeco
Open · sosoai
Params10.7B
Context4K
Smallest6.1 GB
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
OP
OPEN SOLAR KO 10.7B Dpo v1
Open · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB