GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Grok Oss Apollyon 24B
Grok · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LF
LFM2.5 Encoder 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
Coding
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
LF
LFM2.5 1.2B Instruct heretic
Lfm · richardyoung
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
RY
Ryeta 0
Ryeta · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
OR
Ornstein 27B SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
RU
RusMind 4.5.1 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B imatrix
DeepSeek · liodon-ai
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
VI
Violet_Magcap 12B
Violet · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
GH
Ghost 7b Alpha
Ghost · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
AR
Arch Router 1.5B
Arch · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GU
Gumini 1B Base i1
Gumini · GuminiResearch
Params1.08B
Context32K
Q4_K_M0.7 GB
Tool use
QW
Qwen1.5-4B-Chat-AWQ-fp16
Qwen · Qwen
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · bartowski
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
LL
Llama-3-8B-Irene-v0.2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LT
joyai echo ltx25 x Z Image
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
qwen3.8 9b uncensored cyber exploit XRPL v3
Qwen · Krypto-Whitehat
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing