GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
OC
NexaAIDev.Octopus v2
Octopus · DevQuasar-8
Params2.51B
Context8K
Q4_K_M1.6 GB
KU
kunoichi-lemon-royale-v3-32K-7B
Kunoichi · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
S SOLAR 10.7B v1.5 i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
SOLAR 10.7B v1.5
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
NO
NeverSleep/Noromaid-13b-v0.1.1
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
BA
BagelMIsteryTour-8x7B
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
BL
Blind Test
Blind · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama-3-Chatty-2x8B
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
MU
OpenMuQ/MuQ-MuLan-large
Muq · gorse-io
Params—
Context—
Q4_K_M0.6 GB
SI
Silicon-Alice-7B
Silicon · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
MO
FL 12B MoE 2 Safetensors
Moe · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
MI
Undi95 Mixtral 4x7B DPO RPChat
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
NY
L3-Nymeria-v2-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
RoMistral 7b Instruct 2024 05 17
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
EM
EmertonMonarch 7B
Emertonmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Moistral 11B v2
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.6 GB
KU
kunoichi squared model stock 7B
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
etri-xainlp/SOLAR-10.7B-sft-dpo-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
Comsat Embed Ko 8b Preview
Comsat · mykor
Params7.57B
Context40K
Q4_K_M4.7 GB
LY
NM 12B Lyris dev 3
Lyris · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LF
liquid crow
Lfm · lucas-vitrus
Params354M
Context125K
Q4_K_M0.2 GB
ME
saishf/Merge-Mayhem-L3-V2.1
Merge · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
RT
Rth lm code 25b
Rth · RthItalia
Params6.86B
Context2K
Smallest7.3 GB
BO
BondBurger 8x7B
Bondburger · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
AI
Airoboros 7b Gpt4 1.2
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
SI
Silicon-Masha-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
NY
tannedbum/L3-Nymeria-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
AC
nvidia.AceInstruct 72B
Aceinstruct · DevQuasar-7
Params72.7B
Context128K
Q4_K_M47.4 GB