GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
SauerkrautLM Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
llm-compiler-7b
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
HE
HelpingAI2 9B
Helpingai · bartowski
Params8.9B
Context128K
Q4_K_M5.4 GB
OP
openPangu Embedded 7B
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
Meta-Llama-3-120B-Instruct
Llama · mradermacher
Params122B
Context8K
Smallest26.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
Qwen1.5-7B-Chat
Qwen · second-state
Params7.72B
Context32K
Q4_K_M4.8 GB
AP
Nous V1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Llama3 8B Instruct Replete Adapted
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
Scarlett Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM2-2.6B-Transcript
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
IN
Internlm2_5 1_8b Chat
InternLM · gaianet
Params1.89B
Context32K
Q4_K_M1.2 GB
LL
Llama 3.1 SuperNova Lite
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
JA
Jackdaw 30B A3B
Jackdaw · blascotobasco
Params30.5B
Context256K
Q4_K_M18.6 GB
PA
Pasta Lake 7b i1
Pasta · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3.8 Flash Next Uncensored ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
MI
Trinity 2 Codestral 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
OR
Orca 2 13b SFT v6
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
SauerkrautLM Qwen 32b
Qwen · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
MI
minicpm5 1B GLM 5.2 Agentic v7
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
MI
MiniMax M2.5 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
QW
Qwen3.8 Flash Next
Qwen · bitlamas
Params177B
Context256K
Smallest102.5 GB
DA
Dans AdventurousWinds 7b
Dans · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
LFM3 VL 2B Heretic
Lfm · HydroLabs
Params1.73B
Context125K
Smallest1.5 GB
EV
Eva Mindlink 72b
Eva · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Swift Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
WE
WestLake-7B-v2
Westlake · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB