GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
XL
xLAM 7b fc r
Xlam · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
LY
MN 12B Lyra v1
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
AY
Aya Empati v3
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
TR
Trinas Nectar 8B model stock i1
Trinas · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MY
Myriad 7B Slerp
Myriad · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StartLux Decision v1 0.8B
Startlux · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
LL
nvidia/Llama-3.1-8B-UltraLong-1M-Instruct
Llama · DevQuasar-12
Params8.04B
Context1048K
Q4_K_M4.9 GB
SO
SOVLish-Devil-8B-L3
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
HY
HyouKan 3x7B V2 32k
Hyoukan · mradermacher
Params18.5B
Context32K
Q4_K_M11.4 GB
ST
L3 8B Stheno v3.2 MPOA
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DU
DukunLM 7B V1.0 Uncensored sharded i1
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AS
Aspire 8B model stock
Aspire · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-Nephilim-v2-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LE
Lewd Sydney 20B
Lewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
UN
Unholy v2 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
CohereLabs.command A Translate 08 2025
Command · DevQuasar
Params111B
Context8K
Q4_K_M67.1 GB
AP
AppleSauce L2 13B
Applesauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
Models CohereForAI C4Ai Command A 03 2025
Command R · MaziyarPanahi
Params111B
Context16K
Q4_K_M67.1 GB
TI
Tiny Pirate 1.1b v0.2 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
TH
Therapybeagle 11B v2 E1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
CY
Cybil-13B
Cybil · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
Starling LM 7B alpha
Starling · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
StartLux Decision v1 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
TH
Thanos 3B
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB