GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
Llama-3-LewdPlay-8B-evo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OB
OBLIQ IR 3B
Obliq · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RO
rogue-enchantress-32k-7B
Rogue · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
NA
NarumashiRTS V2 i1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
BO
Borealis 10.7B DPO i1
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
MI
MiniusLight 24B v1.01 i1
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
SA
saishf SOVL Mega Mash V2 L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Neophanis 8x7B
Neophanis · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
llama-3-meerkat-8b-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CI
CiQi Agent 7B
Ciqi · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HW
hwkwon S SOLAR 10.7B SFT v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
UN
UniNER 7B all
Uniner · yuuko-eth
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
gemma 7b openhermes i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
IC
Ice0.17 03.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hammer2.1 0.5b
Hammer · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
ST
Sao10K/L3-8B-Stheno-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
MI
Noromaid 7b v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OC
Octen WebGR 0.6B
Octen · mradermacher
Params730M
Context32K
Q4_K_M0.5 GB
AY
aya
Aya · cortexso
Params35B
Context8K
Q4_K_M5.1 GB
JI
jina v5 small
Jina · cstr
Params596M
Context32K
Smallest0.4 GB
IC
Ice0.146 17.10 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Finance Embeddings Investopedia
Finance · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
AI
Airoboros 13b Gpt4 1.3
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
FO
MN 12B FoxFrame Shinori
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
KU
Kuro Lotus 10.7B i1
Kuro · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
MA
Maestrale
Maestrale · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ortho-SOVL-8B-L3
Ortho · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Harmonia 20B
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · RichardErkhov
Params10.7B
Context8K
Q4_K_M6.5 GB
DU
DukunLM 13B V1.0 Uncensored
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB