Open GGUF models

117 GGUF models in the Open family, quantized by 36 uploaders. Sizes run from 135M to 65B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
Open RS3 Q8 0
Open · ysn-rfd
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
OP
Open Reasoner Zero 0.5B
Open · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
OP
Open-RS-8B
Open · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
OP
OPEN SOLAR KO 10.7B mixed v15 dedup
Open · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OP
Open RS DRGRPO
Open · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OP
OPEN SOLAR KO 10.7B S Core
Open · refarde
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
OP
knoveleng Open RS3
Open · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
ReasoningTool use
OP
Vidyc Open_Math_Model
Open · tensorblock
Params596M
Context40K
Smallest0.3 GB
ReasoningTool use
OP
GAI LLM OPEN SOLAR KO 10.7B Dpo v1
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
OP
Open1 1.5B Instruct
Open · Edge-Quant
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
OP
GAI LLM OPEN SOLAR KO 10.7B Dpo Dedup
Open · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
OP
Yi Ko 6B
Open · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OP
Open Reasoner Zero 7B
Open · JohnRoger
Params7.62B
Context128K
Smallest6.3 GB
Reasoning
OP
Open Zagreus 350M Sft
Open · giux78
Params438M
Context4K
Smallest0.5 GB
GGUF
OP
Open gpt4 8x7b v0.2.Q4 K M.Lora Adapter
Open · olfeo
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
OP
Open RS3 Rep
Open · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
OP
open aditi hi v2
Open · bharatcoder
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
OP
Open RS1 Q8 0
Open · lyxinus
Params1.78B
Context128K
Smallest1.9 GB
Tool use
OP
Open0 2.5
Open · MrDevolver
Params32.8B
Context128K
Smallest12.3 GB
GGUF
OP
open
Open · gsstec
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
OP
Open0 2 Lite
Open · Edge-Quant
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
OP
OPEN SOLAR KO 10.7B Q5 K S
Open · ywhwang
Params10.9B
Context4K
Smallest7.5 GB
GGUF
OP
OlympicCoder 7B Sychonix
Open · sychonix
Params7.62B
Context32K
Smallest6.3 GB
CodingReasoningTool use
OP
Chanakya 7B v0.5
Open · NeuroBridge
Params7.24B
Context32K
Smallest7.7 GB
GGUF
OP
open aditi hi v4
Open · NeuroBridge
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing