GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
XL
xLAM 1b Fc R
Xlam · DevQuasar-3
Params1.35B
Context16K
Q4_K_M0.9 GB
TU
turkish summarizer model fixed
Turkish · Yoshiyusuf
Params774M
Context1K
Smallest0.8 GB
ML
MLewdBoros L2 13B SuperCOT i1
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MA
Maestrale Chat v0.3 Beta
Maestrale · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
CoALM 8B
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
winter garden 7b gamma
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TU
TurdusTrixBeagle DARETIES 7B i1
Turdustrixbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniusLight 24B i1
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
JI
Jina Code Embeddings 0.5b
Jina · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
DI
DistilabelBeagle14 7B i1
Distilabelbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx2_MoE_13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
MiaLatte Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Studybuddyv2.1
Studybuddyv · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
ML
MLewd ReMM L2 Chat 20B
Mlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
UL
mlabonne/UltraMerge-7B
Ultramerge · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 13b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
OP
OpenLLM Ro RoLlama3 8b Instruct 2024 06 28
Openllm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
Smegmma-Deluxe-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
PP
PPorpoiseLlama3SOME-8B-slerp
Pporpoisellama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Harmonia no robots 20b i1
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
LL
Llama DNA 1.0 8B Instruct
Llama · dnotitia
Params8.03B
Context128K
Smallest3.2 GB
LL
R1 Distill Llama 8B Anima10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SM
Smegmma-Deluxe-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · NeverSleep
Params8.03B
Context8K
Smallest4.7 GB
UT
Utopia 13B
Utopia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
MI
Mistral 7B Merge 14 v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Noromaid-v0.1-mixtral-8x7b-Instruct-v3
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Llama3 Aloe 8B Alpha
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB