GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenBezoar HH RLHF DPO
Openbezoar · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
TI
Tiny Pirate 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NO
Nox Solar 10.7b v4 Kolon All 10
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
Solus-70B-L2
Solus · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SO
SOLAR 10.7B Sft Dpo v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LY
MN 12B Lyra v3
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LY
MN 12B Lyra v3
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ON
ONS SOLAR 10.7B v1.1
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AC
AceInstruct 1.5B
Aceinstruct · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
MI
Locutusque/Mistral-7B-SFT
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
HA
Hala 9B
Hala · mradermacher
Params8.78B
Context4K
Q4_K_M5.4 GB
Reasoning
RO
RoLlama3.1 8b Instruct 2024 10 09
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AL
AlloyIngotNeoX
Alloyingotneox · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
SLM SQL Base 0.6B
Slm · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
OG
Ogno Monarch Jaskier Merge 7b
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
PS
PsarAI ASR 1B
Psarai · nphearum
Params965M
Context—
Smallest0.3 GB
GGUF
HO
musicgen-hoenn-lofi-3.3B-v1.0-F16
Hoenn · thepatch
Params58M
Context—
Q4_K_M2.2 GB
GGUF
PI
redwood0_pivot-merge-a-7b
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
inswave AISquare Instruct llama2 koen 13b v0.9.24
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PR
proxy lite 3b
Proxy · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool use
CO
C4Ai Command R 08 2024
Command R · second-state
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
BE
DistilabelBeagle14 7B
Beagle · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Caracal GPT
Caracal · mradermacher
Params664M
Context2K
Q4_K_M0.4 GB
GGUF
EX
models--automerger--Experiment26Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenCAI 7B i1
Opencai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
Thespis Krangled 7b v2 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Beyonder 4x7B v3
Kunoichi · mlabonne
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Mistral 7B KNUT Ref
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing