GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
OP
OpenBezoar HH RLHF DPO
Openbezoar · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
TI
Tiny Pirate 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
NO
Nox Solar 10.7b v4 Kolon All 10
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
Solus-70B-L2
Solus · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SO
SOLAR 10.7B Sft Dpo v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
ST
L3-8B-Stheno-v3.1
Stheno · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
LY
MN 12B Lyra v3
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LY
MN 12B Lyra v3
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ON
ONS SOLAR 10.7B v1.1
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
AC
AceInstruct 1.5B
Aceinstruct · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
Locutusque/Mistral-7B-SFT
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
HA
Hala 9B
Hala · mradermacher
Params8.78B
Context4K
Q4_K_M5.4 GB
RO
RoLlama3.1 8b Instruct 2024 10 09
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AL
AlloyIngotNeoX
Alloyingotneox · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
SLM SQL Base 0.6B
Slm · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
OG
Ogno Monarch Jaskier Merge 7b
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PS
PsarAI ASR 1B
Psarai · nphearum
Params965M
Context—
Smallest0.3 GB
HO
musicgen-hoenn-lofi-3.3B-v1.0-F16
Hoenn · thepatch
Params58M
Context—
Q4_K_M2.2 GB
PI
redwood0_pivot-merge-a-7b
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
inswave AISquare Instruct llama2 koen 13b v0.9.24
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
PR
proxy lite 3b
Proxy · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
CO
C4Ai Command R 08 2024
Command R · second-state
Params32.3B
Context128K
Q4_K_M19.8 GB
BE
DistilabelBeagle14 7B
Beagle · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Caracal GPT
Caracal · mradermacher
Params664M
Context2K
Q4_K_M0.4 GB
EX
models--automerger--Experiment26Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCAI 7B i1
Opencai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
Thespis Krangled 7b v2 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Beyonder 4x7B v3
Kunoichi · mlabonne
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Mistral 7B KNUT Ref
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB