GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
Grok Oss Apollyon 24B
Grok · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LF
LFM2.5 Encoder 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · richardyoung
Params1.17B
Context125K
Q4_K_M0.7 GB
RY
Ryeta 0
Ryeta · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
OR
Ornstein 27B SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
RU
RusMind 4.5.1 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
DE
DeepSeek R1 Distill Qwen 14B imatrix
DeepSeek · liodon-ai
Params14.8B
Context128K
Q4_K_M9.0 GB
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
VI
Violet_Magcap 12B
Violet · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
GH
Ghost 7b Alpha
Ghost · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
AR
Arch Router 1.5B
Arch · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GU
Gumini 1B Base i1
Gumini · GuminiResearch
Params1.08B
Context32K
Q4_K_M0.7 GB
QW
Qwen1.5-4B-Chat-AWQ-fp16
Qwen · Qwen
Params3.95B
Context32K
Q4_K_M2.5 GB
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
OP
OpenCoder 8B Instruct
Opencoder · bartowski
Params7.77B
Context8K
Q4_K_M4.7 GB
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
LL
Llama-3-8B-Irene-v0.2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LT
joyai echo ltx25 x Z Image
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
QW
qwen3.8 9b uncensored cyber exploit XRPL v3
Qwen · Krypto-Whitehat
Params9.2B
Context256K
Q4_K_M5.8 GB
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB