GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B A3B SILVER UNCENSORED APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningVision
MI
Mistral 7B Cymraeg Welsh v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
HO
K2 Horizon 3.7B Claude Opus Reasoning Distilled
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
ReasoningTool use
AL
AliceAI Foundation 80B A3B NOESIS BF16
Aliceai · AMAImedia
Params79.6B
Context256K
Q4_K_M48.3 GB
Coding
PY
Pythia 12b
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
QW
Qwen3-235B-A22B-128K
Qwen · unsloth
Params235B
Context128K
Q4_K_M142.2 GB
GGUF
GO
Goetia 24B v1.4 Heretic
Goetia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
TO
ToolSpace 35B A3B
Toolspace · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
qwen3 4b heretic zimage
Qwen · Lockout
Params4B
Context40K
Smallest4.3 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
ColdBrew Qwen3.5 RP_Base CharThink
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
MI
YuisekinAIEvol Mistral 7B ja math v0.1.1
Mistral · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
InternVL3_5 4B
Internvl · bartowski
Params4.41B
Context40K
Q4_K_M2.7 GB
Vision
WO
WorldSim Opus 3.6 35B A3B
Worldsim · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningRoleplayVision
D3
d3 i1
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
OP
weyaxi_openchat-3.5-1210-seraph-slerp
Openchat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ELISARCyberAIEdge7B LoRA
Mistral · sallani
Params42M
Context—
Smallest0.2 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
AM
llm360_amberchat
Amberchat · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
WA
wav2vec2 large xlsr 53 english
Wav · cstr
Params315M
Context—
Smallest0.2 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
GGUF
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
GGUF
GE
gemma 4 E4B it The DECKARD Expresso Universe HERETIC UNCENSORED Thinking
Gemma · DavidAU
Params7.5B
Context128K
Smallest11.3 GB
CodingReasoningRoleplay
NA
Nanbeige 4.3 33B Heretic
Nanbeige · Luni
Params33.1B
Context512K
Smallest7.7 GB
ReasoningTool use
EX
Experiment26 7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 160m Deduped
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
GE
Gemma 4 12B It
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
LL
Llm Jp 3 3.7b
Llm · mmnga
Params3.78B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing