GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
XL
xLAM 1b Fc R
Xlam · DevQuasar-3
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
TU
turkish summarizer model fixed
Turkish · Yoshiyusuf
Params774M
Context1K
Smallest0.8 GB
GGUF
ML
MLewdBoros L2 13B SuperCOT i1
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
Maestrale Chat v0.3 Beta
Maestrale · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
CoALM 8B
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
WI
winter garden 7b gamma
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TU
TurdusTrixBeagle DARETIES 7B i1
Turdustrixbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniusLight 24B i1
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
JI
Jina Code Embeddings 0.5b
Jina · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CodingEmbedding
DI
DistilabelBeagle14 7B i1
Distilabelbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx2_MoE_13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
MiaLatte Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Studybuddyv2.1
Studybuddyv · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
ML
MLewd ReMM L2 Chat 20B
Mlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
UL
mlabonne/UltraMerge-7B
Ultramerge · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 13b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
OpenLLM Ro RoLlama3 8b Instruct 2024 06 28
Openllm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SM
Smegmma-Deluxe-9B-v1
Smegmma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PP
PPorpoiseLlama3SOME-8B-slerp
Pporpoisellama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Harmonia no robots 20b i1
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
LL
Llama DNA 1.0 8B Instruct
Llama · dnotitia
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
R1 Distill Llama 8B Anima10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
SM
Smegmma-Deluxe-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · NeverSleep
Params8.03B
Context8K
Smallest4.7 GB
GGUF
UT
Utopia 13B
Utopia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
MI
Mistral 7B Merge 14 v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
Noromaid-v0.1-mixtral-8x7b-Instruct-v3
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
LL
Llama3 Aloe 8B Alpha
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing