Kosolar GGUF models

73 GGUF models in the Kosolar family, quantized by 6 uploaders. Sizes run from 7.32B to 10.9B parameters. The longest trained context is 4K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.7B v0.2
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
JY623 KoSOLAR 10.7B merge v3.4
Kosolar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR-10.9B-v1.0
Kosolar · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KO
KoSOLAR 10.7B v1.0
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.9 GB
GGUF
KO
KoSOLAR 10.7B merge v3.4
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
KoSOLAR 10.9B v0.3
Kosolar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
Kosolar Hermes Test
Kosolar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
Tool use
KO
KoSOLAR v2.0
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR v0.2 gugutypus 10.7B
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
KoSOLAR v2.1 i1
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.7B merge v1.0
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.7B merge v3.0 i1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
SOLAR 10.7B
Kosolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
KO
KoSOLAR 10.7B merge v3.2
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.7B v2.0
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.9 GB
GGUF
KO
KBNIT KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
KoSOLAR 10.7B DPO Adapter Attach
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
kosolar 4.1 sft
Kosolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
KO
kosolar 4.1 sft
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.9B v0.5
Kosolar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
KO
KoSOLAR 10.7B v0.1
Kosolar · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KO
KoSOLAR 10.7B v2.1
Kosolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR 10.7B merge v3.2
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
spow12/kosolar_4.1_sft
Kosolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoSOLAR v2.0
Kosolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
KO
Jingyeom KoSoLAR 10.7B V0.2_1.4_Dedup_1
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
KO
KoSOLAR 10.9B v0.5
Kosolar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KO
KoSOLAR 10.9B v0.3
Kosolar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF

Keep browsing