GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OC
NexaAIDev.Octopus v2
Octopus · DevQuasar-8
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
KU
kunoichi-lemon-royale-v3-32K-7B
Kunoichi · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
S SOLAR 10.7B v1.5 i1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLAR 10.7B v1.5
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
NO
NeverSleep/Noromaid-13b-v0.1.1
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BA
BagelMIsteryTour-8x7B
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
BL
Blind Test
Blind · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Chatty-2x8B
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
MU
OpenMuQ/MuQ-MuLan-large
Muq · gorse-io
Params—
Context—
Q4_K_M0.6 GB
GGUF
SI
Silicon-Alice-7B
Silicon · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MO
FL 12B MoE 2 Safetensors
Moe · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
MI
Undi95 Mixtral 4x7B DPO RPChat
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
NY
L3-Nymeria-v2-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
RO
RoMistral 7b Instruct 2024 05 17
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EM
EmertonMonarch 7B
Emertonmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Moistral 11B v2
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.6 GB
GGUF
KU
kunoichi squared model stock 7B
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
etri-xainlp/SOLAR-10.7B-sft-dpo-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CO
Comsat Embed Ko 8b Preview
Comsat · mykor
Params7.57B
Context40K
Q4_K_M4.7 GB
Embedding
LY
NM 12B Lyris dev 3
Lyris · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LF
liquid crow
Lfm · lucas-vitrus
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool useVision
ME
saishf/Merge-Mayhem-L3-V2.1
Merge · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RT
Rth lm code 25b
Rth · RthItalia
Params6.86B
Context2K
Smallest7.3 GB
Coding
BO
BondBurger 8x7B
Bondburger · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AI
Airoboros 7b Gpt4 1.2
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SI
Silicon-Masha-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NY
tannedbum/L3-Nymeria-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
AC
nvidia.AceInstruct 72B
Aceinstruct · DevQuasar-7
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF

Keep browsing