GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
GA
GaLLM 14B v0.1
Gallm · TransWithAI
Params14.8B
Context128K
Q4_K_M9.0 GB
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
RA
Elte nlp.Racka 4B
Racka · DevQuasar
Params4.02B
Context40K
Smallest1.7 GB
LL
Taigi-Llama-2-Translator-13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
kyujinpy/Sakura-SOLAR-Instruct
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v1
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
ME
Merge Sakura Solar i1
Merge · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
OO
OOM 13B 02
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
ME
MemoChat Vicuna 33B
Memochat · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
ME
MediX R1 2B
Medix · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
GR
Grammar Synthesis Small WIP
Grammar · mradermacher
Params77M
Context512
Q4_K_M0.1 GB
LL
Llama 3.1 Spellbound StoryWriter 70b instruct 0.4 16bit i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SP
Splade Code 06B
Splade · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
SO
PracticeLLM/SOLAR-tail-10.7B-instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
TinyTalk 2
Tinytalk · TheREZOR
Params19M
Context256
Smallest0.0 GB
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
HY
theNovaAI/Hypernova-experimental
Hypernova · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
KO
KoT platypus2 7B
Kot · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
BA
BatchOnline GRPO 14B
Batchonline · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SA
Sakura SOLAR Instruct DPO v2
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
KO
kyujinpy/Korean-OpenOrca-v3
Korean · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
FL
Flan T5 Xl Grammar Synthesis
Flan · pszemraj
Params2.85B
Context512
Smallest2.3 GB
SO
SOLAR Platypus 10.7B v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Taigi Llama 2 Chat 13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
QW
ToolRM Gen Qwen3 4B Thinking 2507
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
DA
DataVortexS 10.7B Dpo v1.5
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
Calypso 3B alpha v2
Calypso · Aryanne
Params3.43B
Context2K
Smallest2.0 GB