GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen Image 2.1 Uncensored
Qwen · basileleuwa
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q4 K M
Nemotron · mlasli
Params31.6B
Context1024K
Q4_K_M24.5 GB
Roleplay
BA
bagel dpo 20b v04 i1
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
AI
airoboros l2 7b gpt4 1.4.1
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Models Mistralai Mistral Large Instruct 2407
Mistral · MaziyarPanahi
Params123B
Context32K
Q4_K_M73.2 GB
GGUF
LF
LFM2 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
Vision
LL
saiga_llama3_8b
Llama · IlyaGusev
Params8B
Context8K
Smallest3.2 GB
GGUF
MI
FastVideo FastH3 8 Step V2 ComfyUI
Minimax · vantagewithai
Params22B
Context—
Q4_K_M13.6 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
GGUF
ZA
Zarafusionex 1.1 L2 7B
Zarafusionex · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SU
Sulphur 2 distilled Q4 K M
Sulphur · coolthor
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
EH
ehartford_wizardlm-13b-v1.0-uncensored
Ehartford · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
LF
LFM2.5 24B A2B Nyquant Q4 preview
Lfm · XGeorgeCostanzaX
Params24B
Context128K
Smallest12.0 GB
GGUF
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Q4_K_M2.7 GB
Vision
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
ST
stable code 3b
Stable · TheBloke
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
Coding
KR
Kroma v0.3.1 Turbo OPD
Kroma · Abiray
Params12.8B
Context—
Q4_K_M8.8 GB
GGUF
NE
Nemotron 3.5 Bolt 74B A9B CRACK 24GB
Nemotron · dealignai
Params74B
Context256K
Smallest1.0 GB
Vision
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
Vision
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
MA
Magicoder S DS 6.7B
Magicoder · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
rombos Llama3 8B Instruct Replete Adapted i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use

Keep browsing