GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2 1.2B GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
Tool use
GE
Gemmasutra Pro 27B V1F
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
RE
antiven0m/reverie-7b
Reverie · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CL
Clinicalmamba 2.8b Hf
Clinicalmamba · RichardErkhov
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
MI
NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Llama 3 Nephilim v2.1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Beagle14 7B
Neuralbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
c4ai-command-r-plus
Command R · backyardai
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
Conan_Embedding_V1
Conan · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
Embedding
LL
LDCC Instruct Llama 2 Ko 13B v4.1.14
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NY
L3 Nymeria v2 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GO
Go Gourmet
Gourmet · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
PS
PsarAI S2S
Psarai · nphearum
Params—
Context—
Smallest2.0 GB
GGUF
MI
NeverSleep Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
RO
RoLlama2 7b Instruct 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
MI
K2S3 Mistral 7b v1.2
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama xLAM 2 8b Fc R
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
Tool use
MO
Moistral 11B v1
Moistral · BeaverLegacy
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
CO
Command R 35b Writer
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
UL
Ultron Summarizer 1B
Ultron · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
CO
CohereForAI.c4ai Command R7B 12 2024
Command R · DevQuasar-6
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
FI
Kuro Lotus 10.7B
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ON
ONS SOLAR 10.7B v1.1
Ons · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Miqu MS 70B
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
NE
Nemo 12b Humanize KTO Experimental Latest i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
BE
TheGenerator
Betadescribe · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
TowerInstruct 13B v0.1
Towerinstruct · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
OpenLLM Ro RoLlama2 7b Instruct
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing