GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Reason Blend 888k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwen Flash abliterated Strata
Qwen · Hanselor
Params—
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.1 Minitron 4B Width Base
Llama · ThomasBaruzier
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
PH
Phi 3 medium 128k instruct imatrix
Phi · duyntnet
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
MU
Muse Glimmer 30B ROCmFP4 Strix Halo DFlash
Muse · kingjones777
Params28B
Context128K
Smallest1.5 GB
ReasoningTool useVision
FA
Falcon H1 1.5B Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
GGUF
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
QW
Qwen2.5 7B Instruct 1M Heretic
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
Roleplay
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mmnga-o
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MY
MythoLogic-Mini-7b
Mythologic · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BA
bagel 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GL
GLM 4.7 Flash heretic
GLM · ThalisAI
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
PH
Phi 3 mini 4k instruct imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LT
joyai echo ltx25 echoVid
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
GGUF
CO
Cosmos Reason1 7B Heretic
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
DE
Deepseek Llm 7b Chat Abliterated
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.8 Flash Next Mooney
Qwen · DJLougen
Params177B
Context256K
Smallest2.8 GB
Vision
AU
Audar TTS V1 Flash
Audar · audarai
Params553M
Context32K
Q4_K_M0.5 GB
GGUF

Keep browsing