Open GGUF models
117 GGUF models in the Open family, quantized by 36 uploaders. Sizes run from 135M to 65B parameters. The longest trained context is 128K tokens.
OP
Open RS3 i1
Open · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
OP
Open1 7.5B Instruct
Open · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
OP
Open0 2 Lite
Open · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
OP
Open Reasoner Zero 32B
Open · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
OP
Open Xi Math Preview
Open · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
open uka v1 7B
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open_Steuerllm
Open · User954738
Params28B
Context32K
Q4_K_M17.0 GB
OP
open aditi hi v3
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open-RS-7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
Open StarLake Swap 7B imatrix
Open · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.5 GB
OP
Open-RS-DR_GRPO-7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
Open Maid Samantha Hermes Orca dare tiesv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
mayacinka/Open-StaMis-v02-stock
Open · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
MixSwap
Open · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
OP
open cabrita3b
Open · mradermacher
Params3.55B
Context2K
Q4_K_M2.7 GB
OP
Open Neural Monarch Maidv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
open neo.DeepNeo 1 12B Preview
Open · DevQuasar-8
Params12.2B
Context128K
Q4_K_M7.5 GB
OP
knoveleng.Open RS1
Open · DevQuasar-6
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
open hermes sd finetune erot story i1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open Maid Samantha Hermes Orca dare tiesv0.1 i1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open Reasoner Zero 7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
OP
open aditi hi v4
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Yi Ko 6B
Open · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
OP
Open0 2 Lite
Open · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
OP
Open_Maid_Samantha_Hermes_Orca
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
open aditi hi v2
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
allenai.open instruct stanford alpaca 7b
Open · DevQuasar-8
Params6.74B
Context2K
Q4_K_M4.1 GB