GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Q4_K_M21.5 GB
EN
Envoid L3 TenyxChat Daybreak Storywriter RAE 70B
Envoid · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GR
grimjim kuno kunoichi v1 DPO v2 SLERP 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
SO
SOLAR 10.7B Sft Dpo v1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
macadeliccc SOLAR math 2x10.7b v0.2
Macadeliccc · RichardErkhov
Params19.2B
Context4K
Q4_K_M11.6 GB
LL
PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct-v1.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
UR
Urllm Ko 7b
Urllm · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
KI
ReMM v2 Kimiko v2 13B
Kimi · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NE
NeuralOmniWestBeaglake 7B
Neuralomniwestbeaglake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
sraka 27b experimental
Qwen · texdata
Params26.9B
Context256K
Q4_K_M16.5 GB
IC
Ice0.40 20.11 RP i1
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
jina embeddings v5 text nano retrieval Q8A64
Jina · VelociQ8
Params322M
Context8K
Smallest0.3 GB
QW
Qwen2 7B Ko Instruct Orpo Ver_2.0_Wo_Chat
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
FB
fblgit LUNA SOLARkrautLM Instruct
Fblgit · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
RO
RoLlama2-7b-Instruct
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
XL
xLAM 7b R
Xlam · DevQuasar-5
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
aya-23-8B
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Undi95 Xwin MLewd 13B V0.2
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
XG
Salesforce xgen small 9B instruct r
Xgen · ArtusDev
Params10.7B
Context256K
Q4_K_M6.5 GB
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
NoromaidxOpenGPT4 1 i1
Noromaidxopengpt · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
K2S3 Mistral 7b v1.1
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
OX
OxytocinErosEngineeringFX 7B slerp
Oxytocinerosengineeringfx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
Beyonder 4x7B v3 random lora i1
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
CO
code embed v2
Code · divakantpandey
Params125M
Context1K
Smallest0.1 GB
PS
Psyfighter2 Noromaid Ties 13B
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
WI
winter garden 7b gamma i1
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB