GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
CY
Cydonia v1.2 v1.3 Magnum v4 22B i1
Cydonia · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
DA
Dark Nexus 12B v2.0
Dark · ReadyArt
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
QW
Swift1.5 Qwen3.8 Flash Next Mixed Quant
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
Vision
LL
llama 65b hf
Llama · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
KA
fpham_karen_theeditor_13b_hf
Karen · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
NE
Nemotron Terminal 32B
Nemotron · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingReasoningTool use
IQ
IQuest Coder V1 40B Base
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingTool use
NE
neural-chat-7b-v3-3
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CY
Cydonia v1.3 Magnum v4 22B i1
Cydonia · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
VI
felixchao_vicuna-33b-coder
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
LL
Llama-3-8B-LexiFun-Uncensored-V1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
Coding
IN
InternLM2StepProver
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
RY
RynnUnify Agentic Reasoner
Rynnunify · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
ER
Eros Prodigadigm 7B
Eros · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SH
shuttle 3 i1
Shuttle · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen1.5 0.5B
Qwen · mradermacher
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
AP
Apollo V0.1 4B Thinking
Apollo · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LL
Llama-3-Open-Ko-8B-Instruct-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BR
Breeze TTS 2
Breeze · npario
Params—
Context—
Smallest4.3 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
Nemotron Cascade 14B Thinking Impotent Heresy
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
QW
VisReason Pro Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
MI
Ministrations 8B v1
Ministrations · TheDrummer
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
QW
Qwen Image 2.1 Uncensored
Qwen · feeday
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
VisReason Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision

Keep browsing