GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JJ
JJ 1 0.8B
mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
IA
Iambe RP v3 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
OR
Orthrus 12b v0.8 i1
Orthrus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NE
Neophanis 8x7B iMat
Neophanis · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AC
AceInstruct 72B
Aceinstruct · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Coding
OP
OpenBezoar SFT
Openbezoar · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
LY
MN 12B Lyra v1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
llavon ime llama 250m
Llama · tony65535
Params248M
Context384
Q4_K_M0.2 GB
GGUF
CL
ClinicalCamel 70B
Clinicalcamel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
MedCrab 1.5B
Medcrab · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
QW
Nemotron Research GooseReason 4B Instruct
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AS
AstraLM 16B MoE
Astralm · mradermacher
Params15.9B
Context32K
Q4_K_M9.8 GB
Coding
NO
Noromaid 20b v0.1.1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
AC
AceMath 1.5B Instruct
Acemath · mradermacher
Params1.78B
Context4K
Q4_K_M1.1 GB
GGUF
VI
Vigyan 1.5B 4x MoE
Vigyan · mradermacher
Params6.4B
Context128K
Q4_K_M3.9 GB
ReasoningTool use
GE
Gemma3 4b It Comedy v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Nemotron Research Reasoning Qwen 1.5B v2 RLVE
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
SH
SHRDFU 7b beta
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
TH
TherapyBeagle 11B v1
Therapybeagle · QuantFactory
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TO
TowerBase 13B v0.1
Towerbase · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
saishf SOVLish Maid L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TO
Tora 7B v0.2
Tora · MCZK
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
BE
BeagleB 7B i1
Beagleb · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AM
Amethyst 13B
Amethyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LD
LDCC SOLAR gugutypus 10.7B i1
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
EL
electric sheep 7b alpha
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing