GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LF
LFM2 1.2B GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params1.17B
Context125K
Q4_K_M0.7 GB
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GE
Gemmasutra Pro 27B V1F
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
RE
antiven0m/reverie-7b
Reverie · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CL
Clinicalmamba 2.8b Hf
Clinicalmamba · RichardErkhov
Params2.77B
Context1024K
Q4_K_M1.6 GB
MI
NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Beagle14 7B
Neuralbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
c4ai-command-r-plus
Command R · backyardai
Params104B
Context128K
Q4_K_M62.8 GB
CO
Conan_Embedding_V1
Conan · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.14
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
NY
L3 Nymeria v2 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
Go Gourmet
Gourmet · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
PS
PsarAI S2S
Psarai · nphearum
Params—
Context—
Smallest2.0 GB
MI
NeverSleep Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
RO
RoLlama2 7b Instruct 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
K2S3 Mistral 7b v1.2
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
LL
Llama xLAM 2 8b Fc R
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
MO
Moistral 11B v1
Moistral · BeaverLegacy
Params10.7B
Context8K
Q4_K_M6.5 GB
CO
Command R 35b Writer
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
UL
Ultron Summarizer 1B
Ultron · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
CO
CohereForAI.c4ai Command R7B 12 2024
Command R · DevQuasar-6
Params8.03B
Context8K
Q4_K_M5.1 GB
FI
Kuro Lotus 10.7B
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
ON
ONS SOLAR 10.7B v1.1
Ons · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
MI
Miqu MS 70B
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
NE
Nemo 12b Humanize KTO Experimental Latest i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
BE
TheGenerator
Betadescribe · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
TO
TowerInstruct 13B v0.1
Towerinstruct · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
OP
OpenLLM Ro RoLlama2 7b Instruct
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB