Open GGUF models

117 GGUF models in the Open family, quantized by 36 uploaders. Sizes run from 135M to 65B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
Open RS3 i1
Open · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
OP
Open1 7.5B Instruct
Open · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
OP
Open0 2 Lite
Open · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
OP
Open Reasoner Zero 32B
Open · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
OP
Open Xi Math Preview
Open · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OP
open uka v1 7B
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Open_Steuerllm
Open · User954738
Params28B
Context32K
Q4_K_M17.0 GB
GGUF
OP
open aditi hi v3
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Open-RS-7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
OP
Open StarLake Swap 7B imatrix
Open · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.5 GB
GGUF
OP
Open-RS-DR_GRPO-7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
OP
Open Maid Samantha Hermes Orca dare tiesv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
mayacinka/Open-StaMis-v02-stock
Open · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
MixSwap
Open · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
GGUF
OP
open cabrita3b
Open · mradermacher
Params3.55B
Context2K
Q4_K_M2.7 GB
GGUF
OP
Open Neural Monarch Maidv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
open neo.DeepNeo 1 12B Preview
Open · DevQuasar-8
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
OP
knoveleng.Open RS1
Open · DevQuasar-6
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
OP
open hermes sd finetune erot story i1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
Open Maid Samantha Hermes Orca dare tiesv0.1 i1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
Open Reasoner Zero 7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
OP
open aditi hi v4
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Yi Ko 6B
Open · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
OP
Open0 2 Lite
Open · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
OP
Open_Maid_Samantha_Hermes_Orca
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
open aditi hi v2
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
allenai.open instruct stanford alpaca 7b
Open · DevQuasar-8
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing