GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DR
Drama 3 ConfigI
Drama · thetom-ai
Params34.7B
Context256K
Smallest24.3 GB
DB
dbrx instruct iMat
Dbrx · dranger003
Params132B
Context32K
Smallest26.9 GB
PO
Poppy_Porpoise-0.72-L3-8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
EA
EAN 3B
Ean · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
LT
LTX 2.3
Ltx · wuhaixie
Params21B
Context—
Q4_K_M14.2 GB
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
LL
Huihui ai.Llama 3.1 Nemotron Nano 8B v1 Abliterated
Llama · DevQuasar-12
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen Image 2.1 Uncensored
Qwen · laazuri
Params7.12B
Context—
Q4_K_M4.6 GB
AR
ArmenianGPT 1.0 3B
Armeniangpt · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · duyntnet
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen1.5-7B-Chat
Qwen · bartowski
Params7.72B
Context32K
Q4_K_M4.8 GB
OR
Orca 2 13B
Orca · second-state
Params13B
Context4K
Q4_K_M7.9 GB
LF
LFM2.5 VL 450M
Lfm · ZuzeTt
Params354M
Context125K
Q4_K_M0.2 GB
LF
LFM2.5 2.6B Uncensored
Lfm · zaakirio
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
deepseek math 7b instruct
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
VisReason Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OR
OrcaMaid 13b
Orcamaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 4B MegaR3ASONER v1
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
XO
XORTRON NXTXPRTXXL
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
DE
Deepseek Llm 7b Chat
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen 7B
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
VEPO ERM Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
LF
Tanpo Marketing Merged Format v3
Lfm · d4rkninja
Params1.17B
Context125K
Q4_K_M0.7 GB
LF
lfm3 vld 2b
Lfm · webbrain-one
Params1.99B
Context125K
Q4_K_M1.2 GB
HA
Hathor Respawn L3 8B v0.8
Hathor · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · Ex0bit
Params31.6B
Context1024K
Smallest18.2 GB
CO
Cosmos Reason2 8B
Cosmos · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MA
magnum 32b v2 i1
Magnum · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB