GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JJ
JJ 1 0.8B
mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
IA
Iambe RP v3 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
OR
Orthrus 12b v0.8 i1
Orthrus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AY
Aya Expanse 8b Abliterated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
NE
Neophanis 8x7B iMat
Neophanis · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
AC
AceInstruct 72B
Aceinstruct · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
OP
OpenBezoar SFT
Openbezoar · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
LY
MN 12B Lyra v1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
llavon ime llama 250m
Llama · tony65535
Params248M
Context384
Q4_K_M0.2 GB
CL
ClinicalCamel 70B
Clinicalcamel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ME
MedCrab 1.5B
Medcrab · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Nemotron Research GooseReason 4B Instruct
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
AstraLM 16B MoE
Astralm · mradermacher
Params15.9B
Context32K
Q4_K_M9.8 GB
NO
Noromaid 20b v0.1.1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
AC
AceMath 1.5B Instruct
Acemath · mradermacher
Params1.78B
Context4K
Q4_K_M1.1 GB
VI
Vigyan 1.5B 4x MoE
Vigyan · mradermacher
Params6.4B
Context128K
Q4_K_M3.9 GB
GE
Gemma3 4b It Comedy v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Nemotron Research Reasoning Qwen 1.5B v2 RLVE
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
SH
SHRDFU 7b beta
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
TH
TherapyBeagle 11B v1
Therapybeagle · QuantFactory
Params10.7B
Context32K
Q4_K_M6.5 GB
TO
TowerBase 13B v0.1
Towerbase · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SA
saishf SOVLish Maid L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
TO
Tora 7B v0.2
Tora · MCZK
Params7.24B
Context4K
Q4_K_M4.4 GB
BE
BeagleB 7B i1
Beagleb · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
Amethyst 13B
Amethyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LD
LDCC SOLAR gugutypus 10.7B i1
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
EL
electric sheep 7b alpha
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB