GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LF
Luth LFM2 350M
Lfm · kurakurai
Params354M
Context125K
Q4_K_M0.2 GB
SA
Sara 1.5 4B It
Sara · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · Ishowbackup
Params24B
Context128K
Q4_K_M15.4 GB
FA
Fallen Command A 111B v1.1
Fallen · bartowski
Params111B
Context256K
Smallest26.8 GB
QW
Qwen3.8 27B Uncensored cyber
Qwen · nico248000000000
Params27.3B
Context256K
Q4_K_M16.8 GB
LT
LTXV 13B 0.9.8 distilled
Ltx · biali
Params13B
Context—
Q4_K_M8.8 GB
AN
Anubis 70B v1 i1
Anubis · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PR
prettybird_bce_basic_8B
Prettybird · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Google Gemma 4 12B It
Gemma · sigmanih
Params11.9B
Context256K
Smallest9.8 GB
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · ApolloRaines
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Models Huihui Ai Qwen2.5 Coder 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
LL
Llama 3.3 Nemotron 70B Reward Principle
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
stablelm-2-12b-chat
Stablelm · stabilityai
Params12.1B
Context4K
Q4_K_M7.4 GB
QW
14B Qwen2.5 Freya x1 i1
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 Flash Next Uncensored ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
QW
Qwen2.5 Coder 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
LFM2 VL 3B Heretic
Lfm · ZuzeTt
Params2.57B
Context125K
Q4_K_M1.6 GB
RA
Razorback 12B v0.2
Razorback · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
LFM2.5 Encoder 230M
Lfm · LiquidAI
Params230M
Context125K
Smallest0.1 GB
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
DI
Dirty Alice RP 2b i1
Dirty · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Llama 3.1 Minitron 4B Magpie SFT 650K MT
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
LI
L3-8B-LingYang-v2
Lingyang · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
HE
HAI3 RAW
Helpingai · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
CO
Cosmos Reason2 8b
Cosmos · apolo13x
Params8.19B
Context256K
Q4_K_M5.0 GB
AI
Airoboros L2 7b Gpt4 M2.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GA
Gaia LLM 8B
Gaia · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Mistralai Devstral Small 2 24B Instruct 2512
Mistral · sigmanih
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Gutenberg Doppel 22B
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB