GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
HelpingAI 3B hindi i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
Vision
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Swift Qwen3.8 27B Uncensored MTP Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
AT
Athene 70B
Athene · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AR
Arcee Nova
Arcee · arcee-ai
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
BO
NbAiLab/borealis2-26b-a4b-preview
Borealis · NbAiLab
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
LF
LFM2.5-350M
Lfm · ensu-app
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
AR
Armenian GPT 1.0 3B
Armenian · ArmGPT
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
DI
diar streaming sortformer 4spk v2.1
Diar · handy-computer
Params118M
Context—
Smallest0.1 GB
GGUF
QW
Models Qwen Qwen2.5 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated GSQ-RCO IQ3_XXS Calibrated Mixed Hybrid
Qwen · arytekSI
Params177B
Context256K
Smallest83.1 GB
GGUF
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
QW
qwen3 coder next 80b redteam
Qwen · rafw007
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
BO
Borealis 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
HE
HelpingAI 3B coder
Helpingai · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
QW
calme-2.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
ST
stable-code-instruct-3b
Stable · lmstudio-community
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
NE
Nemotron 3.5 Super 120B A12B NVFP4 Strata Blackwell
Nemotron · Cudecnik
Params124B
Context1024K
Smallest71.6 GB
ReasoningTool useVision
QW
Qwen3 Nemotron 32B RLBFF
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
CodeQwen1.5 7B Chat
Qwen · Qwen
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
DE
deepseek coder 7b instruct v1.5
DeepSeek · LoneStriker
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
GGUF
NE
Nemotron 3.5 Bolt 74B A9B 24GB Metal
Nemotron · UraionLabs
Params74B
Context256K
Smallest24.2 GB
ReasoningTool useVision

Keep browsing